-- Logs begin at Fri 2022-08-05 18:46:28 UTC, end at Fri 2022-08-05 20:09:48 UTC. -- Aug 05 19:41:14.497819 dv-cinder-852209-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 19:41:14.507380 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 19:41:14 2022] *** Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: nodename: dv-cinder-852209-2-iscsi Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: machine: x86_64 Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: clock source: unix Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: pcre jit disabled Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: detected number of CPU cores: 4 Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: current working directory: / Aug 05 19:41:14.509324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: detected binary path: /usr/bin/uwsgi-core Aug 05 19:41:14.509926 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: your processes number limit is 47680 Aug 05 19:41:14.509926 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: your memory page size is 4096 bytes Aug 05 19:41:14.509926 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: detected max file descriptor number: 2048 Aug 05 19:41:14.509926 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: lock engine: pthread robust mutexes Aug 05 19:41:14.509926 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: thunder lock: enabled Aug 05 19:41:14.509926 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 19:41:14.509926 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 19:41:14.549696 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: Python main interpreter initialized at 0x562b5c1679c0 Aug 05 19:41:14.549696 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: python threads support enabled Aug 05 19:41:14.549696 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: your server socket listen backlog is limited to 100 connections Aug 05 19:41:14.549696 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: your mercy for graceful operations on workers is 90 seconds Aug 05 19:41:14.550097 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 19:41:14.550097 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: *** Operational MODE: preforking *** Aug 05 19:41:14.550361 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: *** uWSGI is running in multiple interpreter mode *** Aug 05 19:41:14.550361 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: spawned uWSGI master process (pid: 110027) Aug 05 19:41:14.550575 dv-cinder-852209-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 19:41:14.551175 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: spawned uWSGI worker 1 (pid: 110028, cores: 1) Aug 05 19:41:14.551497 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: spawned uWSGI worker 2 (pid: 110029, cores: 1) Aug 05 19:41:14.551617 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 19:41:15.225607 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 19:41:15.245419 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 19:41:16.331510 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:41:16.331510 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: from cryptography.utils import int_from_bytes Aug 05 19:41:16.332263 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:41:16.332263 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: from cryptography.utils import int_from_bytes Aug 05 19:41:16.333587 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:41:16.333587 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: from cryptography.utils import int_from_bytes Aug 05 19:41:16.334113 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:41:16.334113 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: from cryptography.utils import int_from_bytes Aug 05 19:41:18.872421 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:41:18.873003 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:41:18.873170 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:41:18.873557 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:41:18.873804 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:41:18.874270 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.874593 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.874933 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.875249 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.875575 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.875882 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.876197 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.876394 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:41:18.876764 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.876865 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:41:18.876960 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.877051 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.877131 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:41:18.877365 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.877488 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:41:18.877685 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-2-iscsi {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.877820 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:41:18.877998 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.878204 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.878299 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.878522 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.878611 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.878886 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.878993 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.879170 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.879259 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.879497 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.879594 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.879799 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.879891 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.880111 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.880294 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.880742 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.880881 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.880991 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.880991 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.881199 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.881304 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.881420 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.881554 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-2-iscsi {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.881674 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.881868 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.882030 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.882168 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.882297 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.882472 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.882561 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.882816 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.882909 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.883113 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.883212 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.883426 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.883521 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.883725 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.883826 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-2-iscsi {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.884119 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.884270 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.884428 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.884528 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.884738 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.884834 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.885081 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.885167 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.885406 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.885507 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.885713 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.885810 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.886014 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.886113 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.886327 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.886498 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.886654 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.886744 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.886964 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.887070 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.887266 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.887355 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.887574 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.887670 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-2-iscsi {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.887889 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.887980 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.888194 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.888283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.888499 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.888597 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.888802 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.888912 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.889674 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.889887 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.890363 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.890595 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.890836 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.890934 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.891096 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.891239 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.891511 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.891605 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.891824 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.891939 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.893774 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.893901 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.893901 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894073 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894154 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894299 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894394 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894490 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894578 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894710 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894796 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894875 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.894961 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895054 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895147 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895229 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895308 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895387 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895472 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895571 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895654 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895734 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895812 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895890 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.895978 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896059 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896144 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896224 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896303 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896383 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896475 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896562 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896711 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.896829 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.897023 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.897148 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.897336 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.897542 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.897630 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.897794 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.897930 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.898103 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.898214 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.898439 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.898527 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.898777 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.898871 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.899082 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.899173 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.899387 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.899482 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.899690 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.899779 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.899991 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.900079 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.900293 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.900381 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.900599 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.900735 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.900895 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.901002 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.901205 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.901305 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.901513 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.901620 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.901761 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.901858 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.902057 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.902153 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.902357 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.902473 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.902689 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.902802 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.902992 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.903096 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.903293 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.903406 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.903593 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.903689 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.903889 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.903993 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.904190 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.904317 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.904487 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.904594 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.905358 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.905664 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.905768 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.905967 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.906096 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.906268 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.906405 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.906569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.906704 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.906900 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.906989 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.907202 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.907302 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.907515 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.907624 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.907827 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.907915 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.908126 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.908216 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.908422 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.908518 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.908723 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.908810 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.909011 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.909105 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.909308 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.909405 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.909606 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.909701 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.909905 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.910005 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.910203 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.910305 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.910505 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.910604 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.910829 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.910920 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.911127 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.911222 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.911424 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.911518 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.911722 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.911810 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.912029 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.912117 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.912326 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.912449 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.912621 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.912709 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.912919 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.913017 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.913215 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.913304 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.913513 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.913600 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.913810 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.913907 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.914105 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.914191 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.914402 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.914489 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.914727 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.914828 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.915022 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.915108 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.915320 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.915407 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.915615 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.915705 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.915909 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.916004 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.916219 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.916320 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.916513 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.916601 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.916811 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.916896 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.917112 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.917211 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.917407 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.917495 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.917706 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.917796 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.918001 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.918114 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.918298 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.918395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.918590 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.918712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.918985 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.919096 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.919280 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.919373 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.919577 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.919665 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.919870 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.919974 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.920185 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.920810 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.921117 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.921431 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.921542 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.921739 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.921867 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.922122 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.922269 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.922491 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.922768 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.922896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.923096 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:41:18.923225 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.923433 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.923521 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.923764 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.923861 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.924103 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.924192 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.924416 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.924518 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.924746 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.924832 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.925059 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.925157 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.925374 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.925518 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.925676 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.925769 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.925985 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.926074 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.926308 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.926408 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.926617 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.926746 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.926944 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.927043 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.927254 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.927354 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.927560 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.927655 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.927869 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.927974 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.928178 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.928301 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.928492 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.928589 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.928804 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.928901 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.929110 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.929216 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.929411 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.929516 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.929718 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.929816 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.930023 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.930128 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.930330 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.930431 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.930650 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.930797 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.931000 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.931223 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.931360 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.931498 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.931656 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.931799 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.931954 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.932090 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.932225 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.932362 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.932499 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.932634 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.932767 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.932865 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.933066 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.933153 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.933367 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.933468 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.933666 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.933754 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.933965 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.934122 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.934265 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.934367 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.934564 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.934673 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.934894 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.934993 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.935198 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.935367 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.935501 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.935589 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.935804 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.936746 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.937076 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.937383 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.937616 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.937738 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.938051 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.938137 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.938367 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.938535 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.938692 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.938880 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.939004 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.939202 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.939321 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.939518 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.939619 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.939830 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.939926 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.940140 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.940237 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.940450 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.940538 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.940752 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.940840 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.941056 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.941158 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.941365 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.941466 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.941663 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.941753 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.941979 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.942075 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.942286 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.942372 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.942589 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.942751 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.942923 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.943013 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.943228 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.943315 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.943534 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.943621 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.943840 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.943930 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.944143 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.944231 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.944443 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.944539 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.944747 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.944836 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.945052 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.945141 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.945354 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.945451 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.945668 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.945758 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.945966 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.946060 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.946263 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.946368 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.946560 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.946689 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.946887 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.946976 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.947183 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.947280 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.947488 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.947575 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.947791 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.947879 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.948091 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.948254 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.948392 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.948494 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.948691 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.948782 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.948989 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.949091 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.949295 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.949391 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.949598 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.949686 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.949898 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.949994 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.950197 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.950284 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.950495 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.950582 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.950850 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.950941 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.951150 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.951236 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.951466 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.951632 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.951823 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.952157 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.952258 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.952452 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.952541 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.952760 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.952856 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.953072 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.953161 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.953380 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.953468 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.953686 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.953774 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.953984 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.954071 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.954283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.954370 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.954580 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.954698 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.954900 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.954994 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.955200 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.955288 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.955516 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.955604 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.955818 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.955913 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.956117 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.956206 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.956416 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.956506 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.956712 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.956799 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.957021 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.957117 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.957333 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.957420 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.957666 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.957753 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.957975 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.958071 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.958286 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.958372 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.958589 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.958794 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.958917 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.959015 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.959220 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.959307 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.959524 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.959618 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.959827 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.959924 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.960134 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.960233 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.960439 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.960525 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.960744 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.960832 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.961046 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.961168 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.961350 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.961438 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.961654 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.961762 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.961957 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.962045 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.962257 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.962344 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.962553 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.962663 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.962879 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.962979 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.963192 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.963327 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.963516 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.963612 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.963824 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.963921 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.964129 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.964232 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.964438 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.964526 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.964740 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.964829 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.965044 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.965210 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.965346 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.965482 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.965634 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.965722 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.965930 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.966026 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.966231 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.966319 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.966538 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.966670 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.966863 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.966965 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.967197 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.967298 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.967587 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.967903 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.967991 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.968208 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.968297 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.968508 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.968603 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.968834 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.968978 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.969111 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.969427 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.969513 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.969732 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.969819 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.970048 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.970137 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.970364 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.970451 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.970692 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.970797 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.970995 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.971091 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.971312 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.971399 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.971621 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.971725 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.971924 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.972033 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.972220 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.972310 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.972516 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.972617 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.972815 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.972903 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.973119 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.973243 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.973426 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.973529 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.973729 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.973826 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.974033 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.974123 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.974327 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.974430 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.974666 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.974769 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.974960 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.975059 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.975257 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.975359 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.975552 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.975650 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.975854 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.975942 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.976156 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.976245 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.976454 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.976539 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.976755 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.976841 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.977061 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.977150 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.977356 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.977444 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.977653 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.977741 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.977961 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.978049 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.978260 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.978348 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.978556 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.978666 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.978878 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.978968 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.979176 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.979264 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.979486 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.979582 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.979799 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.980059 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.980149 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.980393 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.980488 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.980703 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.980791 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.981004 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.981093 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.981309 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.981396 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.981611 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.981708 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.981914 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.982063 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.982226 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.982314 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.982531 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.982649 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.983412 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.983516 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.983722 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.984028 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.984122 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.984333 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.984469 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.984643 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.984802 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.984967 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.985089 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.985226 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.985316 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.985528 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.985629 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.985833 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.985936 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.986132 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.986229 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.986430 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.986520 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.986753 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.986861 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.987056 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.987144 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.987366 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.987634 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.987728 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.987964 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.988053 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.988261 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.988347 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.988574 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.988662 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.988876 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.988964 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.989179 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.989286 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.989478 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.989576 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.989776 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.989864 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.990112 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.990199 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.990412 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.990589 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.990747 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.990839 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.991050 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.991139 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.991350 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.991438 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.991655 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.991745 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.991955 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.992044 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.992256 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.992354 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.992555 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.992651 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.992852 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.992947 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.993147 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.993234 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.993445 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.993535 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.993741 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.993829 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.994035 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.994134 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.994337 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.994435 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.994671 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.994764 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.994954 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.995054 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.995251 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.995338 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.995548 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.995670 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.995853 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.995969 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.996147 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.996247 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.996444 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.996543 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.996740 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.996852 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.997033 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.997131 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.997327 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.997426 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.997634 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.997732 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.997944 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.998042 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.998241 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.998359 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.999267 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.999625 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.999757 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:18.999935 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.000027 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.000242 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.000403 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.000540 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.000712 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.000841 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.001022 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.001148 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.001325 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.001456 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.001634 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.001754 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.001942 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.002071 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.002246 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.002419 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.002558 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.002751 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.002858 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.002978 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.003161 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.003283 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.003466 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.003603 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.003763 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.003863 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.004068 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.004157 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.004365 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.004468 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.004674 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.004773 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.004975 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.005064 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.005271 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.005359 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.005566 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.005671 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.005875 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.005984 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.006176 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.006272 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.006471 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.006569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.006798 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.006888 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.007096 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.007193 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.007391 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.007480 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.007687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.007775 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.007985 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.008080 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.008283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.008373 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.008587 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.008683 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.008883 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.008979 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.009231 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.009341 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.009467 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.009554 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.009775 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.009872 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.010074 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.010163 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.010371 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.010525 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.010701 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.010813 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.011000 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.011098 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.011297 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.011386 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.011600 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.011699 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.011912 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.011999 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.012219 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.012306 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.012516 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.012622 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.012814 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.012902 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.013111 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.013200 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.013410 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.013507 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.013705 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.013803 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.014029 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.014186 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.014341 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.014743 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.014833 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.015060 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.015148 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.015377 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.015480 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.015760 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.015881 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.016085 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.016221 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.016386 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.016611 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.016701 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.016927 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.017016 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.017232 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.017330 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.017537 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.017626 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.017837 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.017925 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.018155 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.018256 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.018464 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.018553 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.018791 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.018957 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.019099 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.019287 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.019426 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.019558 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.019688 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.019870 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.019993 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.020175 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.020296 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.020481 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.020597 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.020794 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.020913 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.021091 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.021217 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.021403 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.021515 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.021707 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.021803 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.022014 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.022102 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.022312 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.022406 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.022611 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.022742 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.022946 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.023105 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.023249 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.023409 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.023554 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.023714 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.023868 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.024013 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.024182 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.024316 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.024499 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.024620 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.024795 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.024929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.025099 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.025238 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.025401 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.025535 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.025706 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.025945 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.026034 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.026254 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.026434 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.026559 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.026681 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.026901 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.026989 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.027199 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.027295 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.027496 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.027584 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.027794 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.027881 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.028095 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.028193 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.028395 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.028483 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.028694 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.028813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.028994 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.029124 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.029308 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.029428 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.030139 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.030396 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.030843 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.031312 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.031675 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.031910 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.032011 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.032385 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.032490 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.032698 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.033006 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.033104 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.033327 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.033580 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.033671 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.033903 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.034001 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.034244 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.034342 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.034555 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.034661 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.034906 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.035008 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.035229 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.035326 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.035550 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.035640 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.035868 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.035956 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.036166 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.036271 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.036473 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.036576 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.036768 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.036865 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.037090 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.037188 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.037402 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.037491 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.037719 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.037808 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.038060 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.038170 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.038360 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.038450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.038678 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.038771 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.038984 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.039088 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.039302 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.039489 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.039606 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.039713 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.039907 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.040022 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.040223 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.040332 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.040518 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.040605 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.040813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.040902 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.041129 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.041238 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.041428 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.041862 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.041971 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.042061 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.042165 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.042259 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.042350 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.042518 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.042612 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.042846 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.042961 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.043152 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.043242 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.043470 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.043561 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.043784 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.043884 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.044101 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.044198 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.044400 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.044498 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.044708 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.044806 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.045011 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.045108 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.045375 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.046171 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.046405 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.046530 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.046769 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.046885 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.047080 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.047182 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.047394 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.047489 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.047697 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.047794 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.048015 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.048105 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.048339 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.048508 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.048655 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.048822 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.048986 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.049097 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.049315 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.049413 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.049637 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.049727 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.049950 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.050051 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.050263 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.050394 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.050574 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.050698 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.050895 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.051010 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.051193 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.051289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.051496 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.051583 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.051794 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.051892 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.052089 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.052176 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.052385 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.052472 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.052694 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.052795 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.052994 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.053084 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.053293 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.053382 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.053594 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.053683 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.053890 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.053978 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.054186 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.054282 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.054500 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.054596 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.054819 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.054912 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.055123 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.055223 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.055428 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.055518 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.055729 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.055825 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.056044 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.056133 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.056344 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.056434 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.056658 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.056764 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.056962 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.057067 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.057256 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.057345 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.057554 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.057643 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.057851 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.057949 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.058178 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.058274 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.058473 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.058564 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.058811 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.058916 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.059122 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.059210 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.059434 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.059530 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.059735 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.059832 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.060044 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.060141 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.060355 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.060444 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.060665 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.060755 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.061220 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.061660 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.061815 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.061996 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.062132 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.062302 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.062458 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.062604 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.062860 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.062964 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.063174 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.063264 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.063483 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.063572 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.063795 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.063892 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.064100 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.064189 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.064403 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.064500 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.064703 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.064800 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.065002 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.065097 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.065317 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.065406 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.065617 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.065722 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.065933 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.066022 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.066237 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.066334 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.066537 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.066655 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.066861 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.067000 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.067159 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.067249 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.067496 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.067587 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.067794 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.067883 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.068099 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.068187 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.068403 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.068536 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.068711 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.068798 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.069017 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.069114 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.069322 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.069421 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.069627 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.069722 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.069933 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.070072 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.070235 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.070324 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.070540 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.070692 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.070870 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.070971 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.071172 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.071260 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.071476 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.071562 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.071781 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.071878 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.072093 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.072196 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.072410 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.072618 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.072720 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.072937 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.073026 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.073245 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.073343 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.073548 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.073804 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.073904 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.074113 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.074212 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.074433 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.074521 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.074763 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.074857 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.075069 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.075157 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.075371 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.075472 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.075674 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.075763 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.075989 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.076086 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.076286 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.076384 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.076608 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.076917 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.077065 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.077223 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.077410 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.077510 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.077723 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.077814 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.078034 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.078284 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.078452 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.078602 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.078781 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.078909 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.078995 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.079143 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.079291 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.079592 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.079679 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.079899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.079987 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.080206 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.080304 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.080514 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.080612 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.080818 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.080907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.081122 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.081212 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.081428 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.081517 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.081731 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.081820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.082034 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.082137 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.082336 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.082425 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.082674 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.082768 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.082980 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.083069 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.083282 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.083384 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.083581 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.083680 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.083887 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.083976 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.084194 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.084282 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.084494 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.084593 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.084799 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.084887 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.085097 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.085301 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.085417 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.085606 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.085719 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.085927 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.086015 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.086243 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.086331 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.086560 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.086691 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.086894 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.086983 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.087191 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.087291 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.087492 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.087581 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.087789 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.087876 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.088085 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.088183 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.088382 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.088477 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.088682 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.088770 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.088978 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.089079 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.089282 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.089370 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.089583 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.089672 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.089877 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.090048 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.090176 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.090307 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.090479 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.090574 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.090817 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.091022 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.091163 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.091358 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.091459 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.091672 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.091767 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.091987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.092077 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.092893 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.093351 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.093440 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.093708 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.093848 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.094011 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.094099 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.094335 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.094540 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.094675 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.094895 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.094985 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.095213 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.095301 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.095544 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.095643 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.095844 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.095933 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.096144 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.096242 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.096450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.096539 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.096753 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.096849 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.097047 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.097136 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.097352 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.097458 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.097651 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.097739 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.097955 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.098042 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.098254 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.098350 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.098552 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.098672 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.098877 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.098988 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.099179 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.099268 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.099476 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.099565 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.099772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.099871 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.100070 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.100167 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.100367 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.100454 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.100669 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.100764 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.100960 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.101057 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.101261 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.101350 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.101557 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.101656 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.101860 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.101948 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.102159 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.102255 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.102462 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.102552 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.102785 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.102877 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.103102 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.103191 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.103402 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.103499 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.103706 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.103800 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.104010 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.104100 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.104313 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.104403 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.104622 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.104709 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.104929 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.105029 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.105233 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.105322 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.105531 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.105617 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.105861 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.105957 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.106240 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.106383 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.106549 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.106733 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.106891 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.107050 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.107197 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.107376 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.107513 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.107700 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.108395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.108962 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.109059 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.109294 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.109431 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.109603 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.109786 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.109925 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.110246 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.110342 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.110579 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.110700 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.110904 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.110995 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.111205 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.111291 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.111505 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.111595 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.111805 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.111894 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.112110 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.112199 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.112418 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.112518 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.112721 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.112818 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.113017 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.113104 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.113314 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.113412 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.113617 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.113715 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.113914 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.114003 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.114212 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.114310 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.114510 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.114606 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.114834 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.114924 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.115138 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.115230 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.115435 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.115523 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.115733 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.115821 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.116030 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.116120 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.116329 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.116418 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.116629 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.116717 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.116930 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.117018 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.117233 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.117323 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.117529 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.117617 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.117830 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.117920 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.118126 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.118221 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.118427 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.118525 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.118750 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.118854 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.119082 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.119170 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.119407 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.119505 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.119716 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.119804 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.120031 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.120120 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.120336 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.120503 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.120642 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.120726 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.120948 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.121040 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.121252 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.121343 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.121565 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.121652 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.121867 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.121954 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.122169 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.122257 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.122541 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.122676 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.122826 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.122915 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.123135 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.123234 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.123478 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.123578 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.123893 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.124208 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.124321 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.124511 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.124602 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.124830 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.124919 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.125152 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.125317 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.125454 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.125688 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.125905 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.126003 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.126250 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.126346 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.126570 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.126681 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.126895 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.126984 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.127196 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.127287 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.127495 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.127638 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.127795 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.127900 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.128099 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.128189 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.128398 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.128488 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.128697 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.128800 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.128996 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.129085 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.129296 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.129393 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.129595 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.129698 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.129892 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.129985 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.130196 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.130291 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.130494 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.130591 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.130836 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.130973 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.131115 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.131213 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.131413 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.131505 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.131710 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.131799 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.132033 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.132121 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.132356 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.132446 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.132662 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.132749 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.132980 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.133067 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.133284 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.133374 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.133600 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.133689 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.133905 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.134011 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.134205 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.134310 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.134449 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:41:19.134546 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.134832 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.135140 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.135467 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.135773 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.136079 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.136382 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.136687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.136991 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.137295 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.137615 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.137932 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.138231 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.138546 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.138878 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.139690 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.140117 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.140605 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.140978 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.141292 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.141602 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.141912 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.142220 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.142528 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.142862 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.143174 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.143481 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.143793 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.144105 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.144426 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.144746 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.145053 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.145373 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.145690 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.146031 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.146338 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.146696 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.147019 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.147327 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.147631 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.147928 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:41:19.148167 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:41:19.297872 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO dbcounter [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Registered counter for database nova_api Aug 05 19:41:19.307692 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO dbcounter [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Registered counter for database nova_api Aug 05 19:41:19.327944 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_db.sqlalchemy.engines [None req-dc123f58-2781-4766-b9e9-618efded448f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:41:19.329498 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_db.sqlalchemy.engines [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:41:19.336150 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writer thread running {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:41:19.336998 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writer thread running {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:41:19.393313 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.context [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d86af12a-bae6-4132-ab5c-5ddefc8a0b0e(cell1) {{(pid=110029) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 19:41:19.395679 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.context [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d86af12a-bae6-4132-ab5c-5ddefc8a0b0e(cell1) {{(pid=110028) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 19:41:19.397097 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:41:19.397567 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:41:19.399180 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:41:19.399513 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_concurrency.lockutils [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:41:19.399892 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:41:19.399988 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_concurrency.lockutils [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:41:19.400336 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:41:19.401536 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_concurrency.lockutils [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:41:19.402251 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_concurrency.lockutils [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:41:19.402393 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:41:19.402712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_concurrency.lockutils [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:41:19.404281 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO dbcounter [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Registered counter for database nova_cell0 Aug 05 19:41:19.404722 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_concurrency.lockutils [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:41:19.407046 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO dbcounter [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Registered counter for database nova_cell0 Aug 05 19:41:19.410294 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO dbcounter [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Registered counter for database nova_cell1 Aug 05 19:41:19.412458 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO dbcounter [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Registered counter for database nova_cell1 Aug 05 19:41:19.418305 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_db.sqlalchemy.engines [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:41:19.423471 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_db.sqlalchemy.engines [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:41:19.423671 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_db.sqlalchemy.engines [None req-dc123f58-2781-4766-b9e9-618efded448f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:41:19.424060 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_db.sqlalchemy.engines [None req-dc123f58-2781-4766-b9e9-618efded448f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:41:19.426553 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writer thread running {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:41:19.430901 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writer thread running {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:41:19.433122 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writer thread running {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:41:19.566262 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writer thread running {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:41:19.576244 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO dbcounter [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Registered counter for database nova_cell0 Aug 05 19:41:19.578431 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO dbcounter [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Registered counter for database nova_cell0 Aug 05 19:41:19.586248 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_db.sqlalchemy.engines [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:41:19.587789 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG oslo_db.sqlalchemy.engines [None req-dc123f58-2781-4766-b9e9-618efded448f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:41:19.591234 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writer thread running {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:41:19.592028 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writer thread running {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:41:19.936992 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: WARNING keystonemiddleware.auth_token [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:41:19.944235 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: WARNING keystonemiddleware.auth_token [None req-dc123f58-2781-4766-b9e9-618efded448f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:41:19.944617 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: WARNING keystonemiddleware.auth_token [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:41:19.951426 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: WARNING keystonemiddleware.auth_token [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:41:20.287822 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: WARNING keystonemiddleware.auth_token [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:41:20.293783 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: WARNING keystonemiddleware.auth_token [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:41:20.299814 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b5c1679c0 pid: 110029 (default app) Aug 05 19:41:20.301874 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:41:20.303065 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] 10.222.0.86 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Aug 05 19:41:20.303462 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 788 bytes} [Fri Aug 5 19:41:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:41:20.303601 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: WARNING keystonemiddleware.auth_token [None req-dc123f58-2781-4766-b9e9-618efded448f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:41:20.309483 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: WARNING keystonemiddleware.auth_token [None req-dc123f58-2781-4766-b9e9-618efded448f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:41:20.315774 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b5c1679c0 pid: 110028 (default app) Aug 05 19:42:38.050123 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:38.051175 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 05 19:42:38.051570 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 2/2] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:42:38.064721 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writing DB stats nova_api:SELECT=3 {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:42:38.065653 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writing DB stats nova_cell0:SELECT=3 {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:42:38.066871 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writing DB stats nova_cell1:SELECT=3 {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:42:38.067901 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:42:38.979065 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-c7e5cceb-5518-420b-87cb-b97a34d4e5b4 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:39.014239 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-c7e5cceb-5518-420b-87cb-b97a34d4e5b4 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.955723 Aug 05 19:42:39.015063 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 1/3] 10.222.0.86 () {60 vars in 1292 bytes} [Fri Aug 5 19:42:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:42:41.262676 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:41.264394 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-9e54b717-1804-4fea-bfca-49ad1249f960 None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 Aug 05 19:42:41.265021 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 3/4] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:42:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:42:41.786133 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-d9b107be-8273-418c-9c2b-9fa3cef5ed24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "disk": 1, "swap": 0}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:41.810308 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:42:41.810308 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: warnings.warn(msg) Aug 05 19:42:41.845083 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-d9b107be-8273-418c-9c2b-9fa3cef5ed24 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.572594 Aug 05 19:42:41.846907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 2/5] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:42:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 19:42:41.860074 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_api:SELECT=3 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:42:41.861015 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_cell0:SELECT=3 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:42:41.862300 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_cell1:SELECT=3 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:42:41.863155 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:42:42.078718 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-89ceec53-abd7-4c3c-8c21-42316b69cf55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:42.083030 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:42:42.083030 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: warnings.warn(msg) Aug 05 19:42:42.149428 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-89ceec53-abd7-4c3c-8c21-42316b69cf55 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294689 Aug 05 19:42:42.150604 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 4/6] 10.222.0.86 () {64 vars in 1336 bytes} [Fri Aug 5 19:42:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:42:44.494897 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-d9b107be-8273-418c-9c2b-9fa3cef5ed24 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:44.497150 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-d9b107be-8273-418c-9c2b-9fa3cef5ed24 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002741 Aug 05 19:42:44.497530 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 3/7] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:42:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:42:45.199392 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-5b0ad6bc-daa8-445c-8f5e-5a24abe702c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:45.220085 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:42:45.220085 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: warnings.warn(msg) Aug 05 19:42:45.242933 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-5b0ad6bc-daa8-445c-8f5e-5a24abe702c0 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.737814 Aug 05 19:42:45.247414 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 5/8] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:42:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:42:45.256653 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-20f4d091-e68a-44bf-b997-901f10090017 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:45.259027 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:42:45.259027 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: warnings.warn(msg) Aug 05 19:42:45.297153 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-20f4d091-e68a-44bf-b997-901f10090017 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044679 Aug 05 19:42:45.306650 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 4/9] 10.222.0.86 () {64 vars in 1336 bytes} [Fri Aug 5 19:42:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:42:47.553700 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-5b0ad6bc-daa8-445c-8f5e-5a24abe702c0 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:47.554736 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-5b0ad6bc-daa8-445c-8f5e-5a24abe702c0 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 05 19:42:47.555400 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 6/10] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:42:47.987746 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-e4554212-9d82-447e-9b8c-940ac84773b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:48.007226 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-e4554212-9d82-447e-9b8c-940ac84773b3 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442241 Aug 05 19:42:48.007780 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 5/11] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:42:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:42:48.019931 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-bf912359-3ce4-4e1d-b0b0-3a90f9fcd92c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:48.046385 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-bf912359-3ce4-4e1d-b0b0-3a90f9fcd92c admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030195 Aug 05 19:42:48.047223 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 7/12] 10.222.0.86 () {64 vars in 1336 bytes} [Fri Aug 5 19:42:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:42:50.313314 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-e4554212-9d82-447e-9b8c-940ac84773b3 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:50.314356 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-e4554212-9d82-447e-9b8c-940ac84773b3 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 05 19:42:50.314779 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 6/13] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:42:50.751804 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-b3b0c6f9-0015-4222-a76c-c1ddd5453738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:50.771925 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-b3b0c6f9-0015-4222-a76c-c1ddd5453738 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451035 Aug 05 19:42:50.772473 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 8/14] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:42:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 19:42:50.784763 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-708f4ff7-4df2-4d41-b282-169ded66a5e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:50.813855 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-708f4ff7-4df2-4d41-b282-169ded66a5e7 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032861 Aug 05 19:42:50.820131 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 7/15] 10.222.0.86 () {64 vars in 1336 bytes} [Fri Aug 5 19:42:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:42:53.107378 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-b3b0c6f9-0015-4222-a76c-c1ddd5453738 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:53.108366 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-b3b0c6f9-0015-4222-a76c-c1ddd5453738 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 05 19:42:53.108766 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 9/16] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:42:53.553242 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-06c7db61-be6b-436f-890f-2e1250edacd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "swap": 0, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:53.573951 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-06c7db61-be6b-436f-890f-2e1250edacd4 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458527 Aug 05 19:42:53.574962 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 8/17] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:42:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:42:53.588354 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-5b937be4-964c-4d1f-818f-0895cdeacf2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:53.614563 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-5b937be4-964c-4d1f-818f-0895cdeacf2d admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030360 Aug 05 19:42:53.615587 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 10/18] 10.222.0.86 () {64 vars in 1336 bytes} [Fri Aug 5 19:42:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:42:56.122155 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-06c7db61-be6b-436f-890f-2e1250edacd4 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:56.123219 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-06c7db61-be6b-436f-890f-2e1250edacd4 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 05 19:42:56.123618 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 9/19] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:42:56.588236 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-d5a8509e-0a0e-4a0d-b6d1-bbc60e22232b admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:56.613128 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-d5a8509e-0a0e-4a0d-b6d1-bbc60e22232b admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.483109 Aug 05 19:42:56.613657 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 11/20] 10.222.0.86 () {60 vars in 1292 bytes} [Fri Aug 5 19:42:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:42:58.866286 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-06c7db61-be6b-436f-890f-2e1250edacd4 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:42:58.867333 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-06c7db61-be6b-436f-890f-2e1250edacd4 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 05 19:42:58.867736 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 10/21] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:42:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:42:59.297454 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-007c6a27-de08-4a05-99df-12f3d27dadea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "id": "1", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:59.319354 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-007c6a27-de08-4a05-99df-12f3d27dadea admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.445037 Aug 05 19:42:59.319830 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 12/22] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:42:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 19:42:59.334872 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-513c06a2-d355-4937-81e9-6c5be4698c91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:42:59.361765 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-513c06a2-d355-4937-81e9-6c5be4698c91 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031003 Aug 05 19:42:59.362383 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 11/23] 10.222.0.86 () {64 vars in 1333 bytes} [Fri Aug 5 19:42:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:43:01.748551 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-007c6a27-de08-4a05-99df-12f3d27dadea admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:01.749673 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-007c6a27-de08-4a05-99df-12f3d27dadea admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Aug 05 19:43:01.750188 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 13/24] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:43:02.192151 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-c641dc4d-3e53-4d69-aa8e-bae27f2d9914 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:02.211425 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-c641dc4d-3e53-4d69-aa8e-bae27f2d9914 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453678 Aug 05 19:43:02.211972 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 12/25] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:43:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:43:02.225040 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-99e64fda-c7ec-426c-b0fa-4735ac5029df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:02.250873 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-99e64fda-c7ec-426c-b0fa-4735ac5029df admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029361 Aug 05 19:43:02.251472 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 14/26] 10.222.0.86 () {64 vars in 1333 bytes} [Fri Aug 5 19:43:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:43:04.551374 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-c641dc4d-3e53-4d69-aa8e-bae27f2d9914 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:04.552394 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-c641dc4d-3e53-4d69-aa8e-bae27f2d9914 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 05 19:43:04.552792 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 13/27] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:04.933524 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-7a14347a-5b1e-42ad-8c5d-9d4e7ed8daa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:04.952475 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-7a14347a-5b1e-42ad-8c5d-9d4e7ed8daa1 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.392942 Aug 05 19:43:04.953161 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 15/28] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:43:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:43:04.965211 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-9ea97b9a-0683-4e88-a18c-b0fcb6a98929 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:04.990751 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-9ea97b9a-0683-4e88-a18c-b0fcb6a98929 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029320 Aug 05 19:43:04.991318 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 14/29] 10.222.0.86 () {64 vars in 1333 bytes} [Fri Aug 5 19:43:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:43:07.275151 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-7a14347a-5b1e-42ad-8c5d-9d4e7ed8daa1 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:07.278397 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-7a14347a-5b1e-42ad-8c5d-9d4e7ed8daa1 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003709 Aug 05 19:43:07.279545 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 16/30] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:07.782006 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-41ffa165-ed65-4a9f-ba1c-bb1b4ef1e6f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "ram": 8192}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:07.807246 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-41ffa165-ed65-4a9f-ba1c-bb1b4ef1e6f8 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.520959 Aug 05 19:43:07.808490 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 15/31] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:43:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:43:07.821703 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-41a20d37-248a-4220-ad07-c1dbfa5b5797 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:07.849685 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-41a20d37-248a-4220-ad07-c1dbfa5b5797 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031609 Aug 05 19:43:07.850254 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 17/32] 10.222.0.86 () {64 vars in 1333 bytes} [Fri Aug 5 19:43:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:43:10.180749 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-41ffa165-ed65-4a9f-ba1c-bb1b4ef1e6f8 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:10.181849 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-41ffa165-ed65-4a9f-ba1c-bb1b4ef1e6f8 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 05 19:43:10.182454 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 16/33] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:10.646016 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-6f7b2b3d-988a-49ce-995e-41988a515576 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "swap": 0}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:10.666878 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-6f7b2b3d-988a-49ce-995e-41988a515576 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477803 Aug 05 19:43:10.667683 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 18/34] 10.222.0.86 () {64 vars in 1283 bytes} [Fri Aug 5 19:43:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:43:10.679359 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-3ef9e019-30bc-49ce-b807-fadc88288ab4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:10.686255 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:43:10.708561 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-3ef9e019-30bc-49ce-b807-fadc88288ab4 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032547 Aug 05 19:43:10.718348 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 17/35] 10.222.0.86 () {64 vars in 1333 bytes} [Fri Aug 5 19:43:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:43:31.093492 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-6f7b2b3d-988a-49ce-995e-41988a515576 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:31.094491 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-6f7b2b3d-988a-49ce-995e-41988a515576 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 05 19:43:31.094922 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 19/36] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:43:31.504856 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-d50f5559-7d7e-43c8-8511-c76a4b26c042 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:31.524168 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-d50f5559-7d7e-43c8-8511-c76a4b26c042 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.422797 Aug 05 19:43:31.524640 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 18/37] 10.222.0.86 () {60 vars in 1292 bytes} [Fri Aug 5 19:43:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:43:32.606185 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-6f7b2b3d-988a-49ce-995e-41988a515576 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:32.607246 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-6f7b2b3d-988a-49ce-995e-41988a515576 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 05 19:43:32.607636 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 20/38] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:43:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:33.140526 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-faacc97e-2d18-46b9-a173-e7d184763e08 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:33.146270 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.wsgi [None req-faacc97e-2d18-46b9-a173-e7d184763e08 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-faacc97e-2d18-46b9-a173-e7d184763e08 admin admin] Request method failure captured: Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Accept: application/json Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Accept-Encoding: gzip, deflate Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Connection: keep-alive Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Content-Length: 0 Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Host: 10.222.0.86 Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Openstack-Api-Version: compute 2.90 Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Openstack-System-Scope: None Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: User-Agent: python-novaclient Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Auth-Token: gAAAAABi7XLkg8FPJiG3uEAQHZ_AGTplAueGDF9X-1hZNIYktcHZyC7xu0O6SgxQI4VrVwrFOa95TvjUPWIZQsJixsy5tM41ZvpCmChUiconfQEGPhsLbTCAZxt2btXXr37Oo4AptvBEosedcTrHdl-W0VK5Fc5PTPrG9ATX8YUvFugFduX5gSs Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Domain-Id: None Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Domain-Name: None Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Identity-Status: Confirmed Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Is-Admin-Project: True Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Domain-Id: default Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Domain-Name: Default Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Name: admin Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Role: member,admin,reader Aug 05 19:43:33.149569 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Roles: member,admin,reader Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/11aa9c879322427d8920955a2aa93539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_11aa9c879322427d8920955a2aa93539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}] Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant: admin Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant-Name: admin Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User: admin Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Domain-Id: default Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Domain-Name: Default Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Id: 047b4b41672048d8889a2b3bb55b2d97 Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Name: admin Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: method: > Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: exception: Flavor 42 could not be found. Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: action_args: {'id': '42'} Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:43:33.151896 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:33.152929 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.154362 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-faacc97e-2d18-46b9-a173-e7d184763e08 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:43:33.155636 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-faacc97e-2d18-46b9-a173-e7d184763e08 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.399387 Aug 05 19:43:33.155636 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 19/39] 10.222.0.86 () {60 vars in 1190 bytes} [Fri Aug 5 19:43:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:43:33.161201 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-8fb7a426-3bd1-402d-9e6f-a423460ac0fa admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:33.165396 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:43:33.185344 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-8fb7a426-3bd1-402d-9e6f-a423460ac0fa admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027860 Aug 05 19:43:33.186158 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 21/40] 10.222.0.86 () {60 vars in 1210 bytes} [Fri Aug 5 19:43:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:43:33.196029 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-246dc3af-0ed0-462c-9457-fd2321f57c09 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:33.220593 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-246dc3af-0ed0-462c-9457-fd2321f57c09 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028134 Aug 05 19:43:33.221143 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 20/41] 10.222.0.86 () {60 vars in 1210 bytes} [Fri Aug 5 19:43:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:43:33.231529 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-0874c877-a04c-4a68-94a7-50fa7f9d8663 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:33.237513 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.wsgi [None req-0874c877-a04c-4a68-94a7-50fa7f9d8663 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-0874c877-a04c-4a68-94a7-50fa7f9d8663 admin admin] Request method failure captured: Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Accept: application/json Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Accept-Encoding: gzip, deflate Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Connection: keep-alive Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Content-Length: 0 Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Host: 10.222.0.86 Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Openstack-Api-Version: compute 2.90 Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Openstack-System-Scope: None Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: User-Agent: python-novaclient Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Auth-Token: gAAAAABi7XLkg8FPJiG3uEAQHZ_AGTplAueGDF9X-1hZNIYktcHZyC7xu0O6SgxQI4VrVwrFOa95TvjUPWIZQsJixsy5tM41ZvpCmChUiconfQEGPhsLbTCAZxt2btXXr37Oo4AptvBEosedcTrHdl-W0VK5Fc5PTPrG9ATX8YUvFugFduX5gSs Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Domain-Id: None Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Domain-Name: None Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Identity-Status: Confirmed Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Is-Admin-Project: True Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Domain-Id: default Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Domain-Name: Default Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Name: admin Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Role: member,admin,reader Aug 05 19:43:33.240772 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Roles: member,admin,reader Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/11aa9c879322427d8920955a2aa93539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_11aa9c879322427d8920955a2aa93539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}] Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant: admin Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant-Name: admin Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User: admin Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Domain-Id: default Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Domain-Name: Default Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Id: 047b4b41672048d8889a2b3bb55b2d97 Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Name: admin Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: method: > Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: exception: Flavor 42 could not be found. Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: action_args: {'id': '42'} Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:43:33.242289 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:33.243318 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:33.245755 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-0874c877-a04c-4a68-94a7-50fa7f9d8663 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:43:33.247362 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-0874c877-a04c-4a68-94a7-50fa7f9d8663 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015189 Aug 05 19:43:33.247593 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 22/42] 10.222.0.86 () {60 vars in 1190 bytes} [Fri Aug 5 19:43:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:43:34.221847 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-246dc3af-0ed0-462c-9457-fd2321f57c09 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:34.222875 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-246dc3af-0ed0-462c-9457-fd2321f57c09 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 05 19:43:34.223256 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 21/43] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:43:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:34.758469 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-ed0bae35-377d-4fed-8026-093762146b66 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:34.764984 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.wsgi [None req-ed0bae35-377d-4fed-8026-093762146b66 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-ed0bae35-377d-4fed-8026-093762146b66 admin admin] Request method failure captured: Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Accept: application/json Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Accept-Encoding: gzip, deflate Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Connection: keep-alive Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Content-Length: 0 Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Host: 10.222.0.86 Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Openstack-Api-Version: compute 2.90 Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Openstack-System-Scope: None Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: User-Agent: python-novaclient Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Auth-Token: gAAAAABi7XLmSwva4Ga0P8pVuZp-GJVwxTEA4iFNxs688VCsHxQ5U2490k6he9ELcSAt4dbjwx40cTagZa2zr9krkf23rmhc4h2Ca0rtGqJ-UyV9XFyccr68ga_f5yZE96FSlOIeDeh8XHbFOtZ6VcC_Bh4aHdIdQ75Qz2jda19OaBik5MsO80w Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Domain-Id: None Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Domain-Name: None Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Identity-Status: Confirmed Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Is-Admin-Project: True Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Domain-Id: default Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Domain-Name: Default Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Name: admin Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Role: member,admin,reader Aug 05 19:43:34.766569 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Roles: member,admin,reader Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/11aa9c879322427d8920955a2aa93539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_11aa9c879322427d8920955a2aa93539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}] Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant: admin Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant-Name: admin Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User: admin Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Domain-Id: default Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Domain-Name: Default Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Id: 047b4b41672048d8889a2b3bb55b2d97 Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Name: admin Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: method: > Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: exception: Flavor 84 could not be found. Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: action_args: {'id': '84'} Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:43:34.767899 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:34.768687 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.769813 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-ed0bae35-377d-4fed-8026-093762146b66 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:43:34.770868 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-ed0bae35-377d-4fed-8026-093762146b66 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404389 Aug 05 19:43:34.770868 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 23/44] 10.222.0.86 () {60 vars in 1190 bytes} [Fri Aug 5 19:43:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:43:34.778249 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-ef2a8c8e-5c13-4757-a0ac-a1f83c3c3cda admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:34.793602 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-ef2a8c8e-5c13-4757-a0ac-a1f83c3c3cda admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019396 Aug 05 19:43:34.794133 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 22/45] 10.222.0.86 () {60 vars in 1210 bytes} [Fri Aug 5 19:43:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:43:34.803725 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-aa8fcb2e-c95e-46b4-aec3-4597f9bd91e5 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:34.820949 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-aa8fcb2e-c95e-46b4-aec3-4597f9bd91e5 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020685 Aug 05 19:43:34.821479 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 24/46] 10.222.0.86 () {60 vars in 1210 bytes} [Fri Aug 5 19:43:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:43:34.830851 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-30d2a44c-a53b-4bc2-b76e-aca3821a1e9d admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:34.836201 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.wsgi [None req-30d2a44c-a53b-4bc2-b76e-aca3821a1e9d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-30d2a44c-a53b-4bc2-b76e-aca3821a1e9d admin admin] Request method failure captured: Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Accept: application/json Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Accept-Encoding: gzip, deflate Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Connection: keep-alive Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Content-Length: 0 Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Host: 10.222.0.86 Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Openstack-Api-Version: compute 2.90 Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Openstack-System-Scope: None Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: User-Agent: python-novaclient Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Auth-Token: gAAAAABi7XLmSwva4Ga0P8pVuZp-GJVwxTEA4iFNxs688VCsHxQ5U2490k6he9ELcSAt4dbjwx40cTagZa2zr9krkf23rmhc4h2Ca0rtGqJ-UyV9XFyccr68ga_f5yZE96FSlOIeDeh8XHbFOtZ6VcC_Bh4aHdIdQ75Qz2jda19OaBik5MsO80w Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Domain-Id: None Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Domain-Name: None Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Identity-Status: Confirmed Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Is-Admin-Project: True Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Domain-Id: default Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Domain-Name: Default Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Name: admin Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Role: member,admin,reader Aug 05 19:43:34.837712 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Roles: member,admin,reader Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/11aa9c879322427d8920955a2aa93539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_11aa9c879322427d8920955a2aa93539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}] Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant: admin Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant-Name: admin Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User: admin Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Domain-Id: default Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Domain-Name: Default Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Id: 047b4b41672048d8889a2b3bb55b2d97 Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Name: admin Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: method: > Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: exception: Flavor 84 could not be found. Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: action_args: {'id': '84'} Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:43:34.839301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:34.840180 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:34.841450 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-30d2a44c-a53b-4bc2-b76e-aca3821a1e9d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:43:34.842510 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-30d2a44c-a53b-4bc2-b76e-aca3821a1e9d admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011720 Aug 05 19:43:34.842510 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 23/47] 10.222.0.86 () {60 vars in 1190 bytes} [Fri Aug 5 19:43:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:43:35.824693 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-aa8fcb2e-c95e-46b4-aec3-4597f9bd91e5 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:35.825724 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-aa8fcb2e-c95e-46b4-aec3-4597f9bd91e5 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 05 19:43:35.826109 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 25/48] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:36.355532 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-5a9f300e-ce78-4ec8-a7ec-eb40804987a8 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:36.361301 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.wsgi [None req-5a9f300e-ce78-4ec8-a7ec-eb40804987a8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-5a9f300e-ce78-4ec8-a7ec-eb40804987a8 admin admin] Request method failure captured: Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Accept: application/json Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Accept-Encoding: gzip, deflate Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Connection: keep-alive Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Content-Length: 0 Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Host: 10.222.0.86 Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Openstack-Api-Version: compute 2.90 Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Openstack-System-Scope: None Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: User-Agent: python-novaclient Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Auth-Token: gAAAAABi7XLn3_7BTpOb0mfZ3wKOBXCdiDuWCATOURL7M61erJ7dqrkfVqusEIKalY-xOp_SQH9jdZVmwDuzHnlX8zKiHvPuDa-5YLl7gdP-jdrJdkzCIW-45MnFAdyZcbH8ZZiVFul3y6FSrDgc83_YS9aRZsbFCcZcM6RzB2I4UqVxDk3n3M8 Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Domain-Id: None Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Domain-Name: None Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Identity-Status: Confirmed Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Is-Admin-Project: True Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Domain-Id: default Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Domain-Name: Default Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Project-Name: admin Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Role: member,admin,reader Aug 05 19:43:36.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Roles: member,admin,reader Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/11aa9c879322427d8920955a2aa93539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_11aa9c879322427d8920955a2aa93539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}] Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant: admin Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-Tenant-Name: admin Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User: admin Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Domain-Id: default Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Domain-Name: Default Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Id: 047b4b41672048d8889a2b3bb55b2d97 Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: X-User-Name: admin Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: method: > Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: exception: Flavor 451 could not be found. Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: action_args: {'id': '451'} Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:43:36.364389 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:36.365395 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.366907 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-5a9f300e-ce78-4ec8-a7ec-eb40804987a8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:43:36.368278 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-5a9f300e-ce78-4ec8-a7ec-eb40804987a8 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395939 Aug 05 19:43:36.368278 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 24/49] 10.222.0.86 () {60 vars in 1193 bytes} [Fri Aug 5 19:43:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:43:36.374386 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-79d88584-4d03-4a71-b8a4-c3fc80877e76 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:36.390185 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-79d88584-4d03-4a71-b8a4-c3fc80877e76 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019348 Aug 05 19:43:36.390872 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 26/50] 10.222.0.86 () {60 vars in 1210 bytes} [Fri Aug 5 19:43:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:43:36.400777 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:36.415976 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019186 Aug 05 19:43:36.416508 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 25/51] 10.222.0.86 () {60 vars in 1210 bytes} [Fri Aug 5 19:43:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:43:36.426010 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-27ba5ce2-4afb-43d5-97d5-f60553a5dcfc admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:36.431417 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.wsgi [None req-27ba5ce2-4afb-43d5-97d5-f60553a5dcfc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-27ba5ce2-4afb-43d5-97d5-f60553a5dcfc admin admin] Request method failure captured: Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Accept: application/json Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Accept-Encoding: gzip, deflate Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Connection: keep-alive Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Content-Length: 0 Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Host: 10.222.0.86 Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Openstack-Api-Version: compute 2.90 Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Openstack-System-Scope: None Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: User-Agent: python-novaclient Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Auth-Token: gAAAAABi7XLn3_7BTpOb0mfZ3wKOBXCdiDuWCATOURL7M61erJ7dqrkfVqusEIKalY-xOp_SQH9jdZVmwDuzHnlX8zKiHvPuDa-5YLl7gdP-jdrJdkzCIW-45MnFAdyZcbH8ZZiVFul3y6FSrDgc83_YS9aRZsbFCcZcM6RzB2I4UqVxDk3n3M8 Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Domain-Id: None Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Domain-Name: None Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Identity-Status: Confirmed Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Is-Admin-Project: True Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Domain-Id: default Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Domain-Name: Default Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Project-Name: admin Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Role: member,admin,reader Aug 05 19:43:36.432987 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Roles: member,admin,reader Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/11aa9c879322427d8920955a2aa93539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_11aa9c879322427d8920955a2aa93539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/11aa9c879322427d8920955a2aa93539"}]}] Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant: admin Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant-Id: 11aa9c879322427d8920955a2aa93539 Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-Tenant-Name: admin Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User: admin Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Domain-Id: default Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Domain-Name: Default Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Id: 047b4b41672048d8889a2b3bb55b2d97 Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: X-User-Name: admin Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: method: > Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: exception: Flavor 451 could not be found. Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: action_args: {'id': '451'} Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:43:36.434515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:36.435977 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: ERROR nova.api.openstack.wsgi Aug 05 19:43:36.437283 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-27ba5ce2-4afb-43d5-97d5-f60553a5dcfc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:43:36.438528 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-27ba5ce2-4afb-43d5-97d5-f60553a5dcfc admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011807 Aug 05 19:43:36.438528 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 27/52] 10.222.0.86 () {60 vars in 1193 bytes} [Fri Aug 5 19:43:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:43:37.421735 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:37.422894 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Aug 05 19:43:37.423364 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 26/53] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:43:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:37.944467 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-2e3b696b-5f8b-4c54-9291-d7de55f7002a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:37.965668 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-2e3b696b-5f8b-4c54-9291-d7de55f7002a admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403328 Aug 05 19:43:37.966213 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 28/54] 10.222.0.86 () {64 vars in 1235 bytes} [Fri Aug 5 19:43:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:43:38.945867 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:38.946917 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 05 19:43:38.947380 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 27/55] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:43:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:39.484865 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-0143dbac-0cec-4ef5-a93d-d2c956ad490a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:39.504951 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-0143dbac-0cec-4ef5-a93d-d2c956ad490a admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.419476 Aug 05 19:43:39.505692 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 29/56] 10.222.0.86 () {64 vars in 1235 bytes} [Fri Aug 5 19:43:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:43:40.525466 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:40.526471 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 05 19:43:40.526989 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 28/57] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:41.057901 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-29f257eb-4921-482f-a74a-ca76b54132df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:41.076960 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-29f257eb-4921-482f-a74a-ca76b54132df admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.411717 Aug 05 19:43:41.077503 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 30/58] 10.222.0.86 () {64 vars in 1235 bytes} [Fri Aug 5 19:43:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:43:42.049613 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:42.050605 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 05 19:43:42.051015 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 29/59] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:43:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:42.588310 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-5a0b84b3-1e47-4d08-acf9-c3e73b11dbb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:43:42.606657 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-5a0b84b3-1e47-4d08-acf9-c3e73b11dbb8 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.414378 Aug 05 19:43:42.607221 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 31/60] 10.222.0.86 () {64 vars in 1235 bytes} [Fri Aug 5 19:43:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:43:43.648442 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:43.649472 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 05 19:43:43.650346 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 30/61] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:43:44.186878 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-dabd52d9-8e2f-4cee-9db8-433b45cc17f1 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:43:44.208223 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-dabd52d9-8e2f-4cee-9db8-433b45cc17f1 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.413386 Aug 05 19:43:44.209025 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 32/62] 10.222.0.86 () {60 vars in 1202 bytes} [Fri Aug 5 19:43:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:44:36.497842 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:44:36.498910 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-dea598ef-255c-448e-bb6b-3bbb1906757d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 05 19:44:36.499305 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 31/63] 10.222.0.86 () {54 vars in 931 bytes} [Fri Aug 5 19:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:44:36.510016 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:44:36.900262 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-97f571c2-b9a5-4241-8a09-1b3fb45f16a1 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:44:36.920734 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-97f571c2-b9a5-4241-8a09-1b3fb45f16a1 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415337 Aug 05 19:44:36.921208 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 33/64] 10.222.0.86 () {60 vars in 1292 bytes} [Fri Aug 5 19:44:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:44:36.942194 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG dbcounter [-] [110028] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:44:36.946560 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-936a88ea-a134-41f6-9b4d-68a4103de848 admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:44:36.954597 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-936a88ea-a134-41f6-9b4d-68a4103de848 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013787 Aug 05 19:44:36.955141 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 32/65] 10.222.0.86 () {60 vars in 1283 bytes} [Fri Aug 5 19:44:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:44:36.967399 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-3c751d89-1747-486d-b206-3422417cc5b6 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:44:36.975050 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-3c751d89-1747-486d-b206-3422417cc5b6 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011163 Aug 05 19:44:36.975633 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 34/66] 10.222.0.86 () {60 vars in 1286 bytes} [Fri Aug 5 19:44:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:44:36.987927 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:44:36.996736 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012598 Aug 05 19:44:36.997269 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 33/67] 10.222.0.86 () {60 vars in 1286 bytes} [Fri Aug 5 19:44:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:44:37.009579 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-6bbfe93f-5f09-4974-87dc-88c40c27f6dd admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:44:37.017345 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-6bbfe93f-5f09-4974-87dc-88c40c27f6dd admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012035 Aug 05 19:44:37.017860 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 35/68] 10.222.0.86 () {60 vars in 1283 bytes} [Fri Aug 5 19:44:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:47:37.801820 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:47:37.802976 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Aug 05 19:47:37.803421 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 34/69] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:47:37.957691 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_api:SELECT=6 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:47:38.140553 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-890b5601-c202-406e-9b0c-6fafbee21c7a admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:47:38.144537 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:47:38.144537 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: warnings.warn(msg) Aug 05 19:47:38.145888 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-890b5601-c202-406e-9b0c-6fafbee21c7a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:47:38.146440 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-890b5601-c202-406e-9b0c-6fafbee21c7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:47:38.146930 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-890b5601-c202-406e-9b0c-6fafbee21c7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:47:38.147658 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-890b5601-c202-406e-9b0c-6fafbee21c7a admin admin] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:47:38.148178 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-890b5601-c202-406e-9b0c-6fafbee21c7a admin admin] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:47:38.148594 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-890b5601-c202-406e-9b0c-6fafbee21c7a admin admin] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:47:38.186681 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-890b5601-c202-406e-9b0c-6fafbee21c7a admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.230910 Aug 05 19:47:38.187515 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 36/70] 10.222.0.86 () {60 vars in 1193 bytes} [Fri Aug 5 19:47:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:47:39.051986 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:47:39.052984 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 05 19:47:39.053373 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 35/71] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:47:39.251928 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-4907a679-b722-4222-9233-6a3290f83e33 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:47:39.254300 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:47:39.254300 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: warnings.warn(msg) Aug 05 19:47:39.255443 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-4907a679-b722-4222-9233-6a3290f83e33 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:47:39.255923 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-4907a679-b722-4222-9233-6a3290f83e33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:47:39.256348 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-4907a679-b722-4222-9233-6a3290f83e33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:47:39.257065 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-4907a679-b722-4222-9233-6a3290f83e33 admin admin] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:47:39.257502 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-4907a679-b722-4222-9233-6a3290f83e33 admin admin] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:47:39.257915 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-4907a679-b722-4222-9233-6a3290f83e33 admin admin] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:47:39.279440 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-4907a679-b722-4222-9233-6a3290f83e33 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083270 Aug 05 19:47:39.280014 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 37/72] 10.222.0.86 () {60 vars in 1193 bytes} [Fri Aug 5 19:47:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:47:50.539155 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:47:50.540146 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 05 19:47:50.540528 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 36/73] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:47:50.685869 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_cell0:SELECT=4 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:47:50.686859 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_cell1:SELECT=4 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:47:50.687196 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG dbcounter [-] [110029] Writing DB stats nova_api:SELECT=8 {{(pid=110029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:47:50.736547 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-e8b397a0-e67d-4d4f-bf95-ca1aa32266ae admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:47:50.738906 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:47:50.738906 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: warnings.warn(msg) Aug 05 19:47:50.740001 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-e8b397a0-e67d-4d4f-bf95-ca1aa32266ae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:47:50.740479 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-e8b397a0-e67d-4d4f-bf95-ca1aa32266ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:47:50.740900 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-e8b397a0-e67d-4d4f-bf95-ca1aa32266ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:47:50.741613 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-e8b397a0-e67d-4d4f-bf95-ca1aa32266ae admin admin] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:47:50.742058 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-e8b397a0-e67d-4d4f-bf95-ca1aa32266ae admin admin] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:47:50.742471 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-e8b397a0-e67d-4d4f-bf95-ca1aa32266ae admin admin] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:47:50.767381 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-e8b397a0-e67d-4d4f-bf95-ca1aa32266ae admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086317 Aug 05 19:47:50.767926 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 38/74] 10.222.0.86 () {60 vars in 1193 bytes} [Fri Aug 5 19:47:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:47:51.597794 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: DEBUG nova.api.openstack.wsgi [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] Calling method '>' {{(pid=110028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:47:51.598834 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: INFO nova.api.openstack.requestlog [None req-511a8acf-844b-4dc9-ac09-5c9e70a6e0fc admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 05 19:47:51.599232 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: [pid: 110028|app: 0|req: 37/75] 10.222.0.86 () {56 vars in 1074 bytes} [Fri Aug 5 19:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:47:51.796778 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG nova.api.openstack.wsgi [None req-24cdcad2-a1fc-4533-bc41-f882f5151360 admin admin] Calling method '>' {{(pid=110029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:47:51.799306 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:47:51.799306 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: warnings.warn(msg) Aug 05 19:47:51.800399 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-24cdcad2-a1fc-4533-bc41-f882f5151360 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:47:51.800868 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-24cdcad2-a1fc-4533-bc41-f882f5151360 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:47:51.801290 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-24cdcad2-a1fc-4533-bc41-f882f5151360 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:47:51.802005 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-24cdcad2-a1fc-4533-bc41-f882f5151360 admin admin] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:47:51.802446 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-24cdcad2-a1fc-4533-bc41-f882f5151360 admin admin] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:47:51.802884 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: DEBUG oslo_concurrency.lockutils [None req-24cdcad2-a1fc-4533-bc41-f882f5151360 admin admin] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:47:51.824313 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: INFO nova.api.openstack.requestlog [None req-24cdcad2-a1fc-4533-bc41-f882f5151360 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083247 Aug 05 19:47:51.824864 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: [pid: 110029|app: 0|req: 39/76] 10.222.0.86 () {60 vars in 1193 bytes} [Fri Aug 5 19:47:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:48:51.087178 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: Fri Aug 5 19:48:51 2022 - graceful shutdown triggered... Aug 05 19:48:51.087304 dv-cinder-852209-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 19:48:51.088189 dv-cinder-852209-2-iscsi devstack@n-api.service[110028]: Gracefully killing worker 1 (pid: 110028)... Aug 05 19:48:51.089189 dv-cinder-852209-2-iscsi devstack@n-api.service[110029]: Gracefully killing worker 2 (pid: 110029)... Aug 05 19:48:52.088324 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: worker 1 buried after 1 seconds Aug 05 19:48:52.088911 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: worker 2 buried after 1 seconds Aug 05 19:48:52.088911 dv-cinder-852209-2-iscsi devstack@n-api.service[110027]: goodbye to uWSGI. Aug 05 19:48:52.089924 dv-cinder-852209-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 19:48:52.090483 dv-cinder-852209-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 19:48:52.093551 dv-cinder-852209-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 19:48:52.104840 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 19:48:52 2022] *** Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: nodename: dv-cinder-852209-2-iscsi Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: machine: x86_64 Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: clock source: unix Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: pcre jit disabled Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: detected number of CPU cores: 4 Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: current working directory: / Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: detected binary path: /usr/bin/uwsgi-core Aug 05 19:48:52.107061 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: your processes number limit is 47680 Aug 05 19:48:52.108050 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: your memory page size is 4096 bytes Aug 05 19:48:52.108050 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: detected max file descriptor number: 2048 Aug 05 19:48:52.108050 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: lock engine: pthread robust mutexes Aug 05 19:48:52.108050 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: thunder lock: enabled Aug 05 19:48:52.108050 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 19:48:52.108050 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 19:48:52.151212 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: Python main interpreter initialized at 0x561fc06a29c0 Aug 05 19:48:52.151212 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: python threads support enabled Aug 05 19:48:52.151212 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: your server socket listen backlog is limited to 100 connections Aug 05 19:48:52.151212 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: your mercy for graceful operations on workers is 90 seconds Aug 05 19:48:52.151647 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 19:48:52.151647 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: *** Operational MODE: preforking *** Aug 05 19:48:52.151981 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: *** uWSGI is running in multiple interpreter mode *** Aug 05 19:48:52.151981 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: spawned uWSGI master process (pid: 124532) Aug 05 19:48:52.152146 dv-cinder-852209-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 19:48:52.155196 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: spawned uWSGI worker 1 (pid: 124552, cores: 1) Aug 05 19:48:52.155563 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: spawned uWSGI worker 2 (pid: 124553, cores: 1) Aug 05 19:48:52.155742 dv-cinder-852209-2-iscsi devstack@n-api.service[124532]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 19:48:52.845990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 19:48:52.869784 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 19:48:54.033941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:48:54.033941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: from cryptography.utils import int_from_bytes Aug 05 19:48:54.034561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:48:54.034561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: from cryptography.utils import int_from_bytes Aug 05 19:48:54.073590 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:48:54.073590 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: from cryptography.utils import int_from_bytes Aug 05 19:48:54.074169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:48:54.074169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: from cryptography.utils import int_from_bytes Aug 05 19:48:56.406779 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:48:56.407540 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:48:56.407787 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:48:56.407957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:48:56.408263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:48:56.408626 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.409004 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.409336 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.409665 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.410006 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.410326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.410682 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.411013 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.411352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.411621 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.411951 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.412288 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-2-iscsi {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.412621 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.412943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.413261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.413588 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.413899 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.414231 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.414556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.415097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.416332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.416332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.416332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.416582 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.416815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.417131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.417483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.417780 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.418103 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.418423 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.418861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-2-iscsi {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.419190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.419509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.421258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.421258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.421258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.421258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.421643 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.421643 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.421957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.422297 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.422678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.422980 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.423309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.423621 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.423935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.424247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.424574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.424887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.425931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.425931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.425931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.426195 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.426393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.426746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.427004 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.427259 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.427605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.427921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.428241 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.428549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.428862 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.429177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.429507 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.429810 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.430128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.430441 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.430790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.431114 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.431443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.431753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.432080 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.432752 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.433007 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.433323 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.433675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.434001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.434363 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.434662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.434992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.435340 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.436149 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.436479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.436791 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.437131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.437444 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.437699 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.438007 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.438320 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.438664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.438982 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.439296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.439623 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.439920 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.440230 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.440546 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.440857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.441247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.441481 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.441794 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.442268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.442432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.442748 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.443074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.443401 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.443715 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.444036 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.444348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.444749 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.445383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.445383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.445742 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.445958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.446885 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.446885 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.446885 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.447129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.447439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.447764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.448077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.448392 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.451753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.451753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.451753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.451753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.451753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.451753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.451753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.451753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.453521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.453521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.453521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.453521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.453521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.453521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.453521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.453990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.454156 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.454497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.454953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.455273 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.455621 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.455960 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.456287 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.456605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.456927 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.457261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.457582 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.457898 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.458218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.458541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.458894 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.459229 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.459556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.459886 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.460210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.460526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.460852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.461187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.461517 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.461835 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.462183 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.462533 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.462879 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.463210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.463541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.463859 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.464247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.464494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.464986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.465335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.465659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.465984 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.466304 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.466921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.467030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.467293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.467612 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.467958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.468338 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.468596 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.468913 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.469398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.469724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.470049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.472849 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.473201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.474055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.474055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.474347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.474691 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.475019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.475315 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:48:56.475749 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.475830 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:48:56.475902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.475983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.476063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:48:56.476401 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.476498 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:48:56.476584 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.476668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:48:56.476920 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.477099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.477261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.477415 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.477566 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.477725 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.477876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.478162 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.478323 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.478594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.478824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.478990 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.479152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.479312 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.479477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.479640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.479800 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.479953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.480118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.480350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.480816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.480983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.481135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.481302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-2-iscsi {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.481467 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.481620 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.481782 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.481934 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.482096 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.482347 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.482584 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.482854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.483050 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.483205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.483369 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.483524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.483524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.483818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.483818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.484127 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.484127 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.484460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.484612 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.484772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.484924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.485075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.485242 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.485421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.485587 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.485747 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.485911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.486072 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.486224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.486383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.486543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.486716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.486884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.487045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.487205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.487357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.487357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.487654 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-2-iscsi {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.487830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.487991 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.488175 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.488342 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.488494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.488675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.488837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.488999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.489159 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.489322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.489481 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.489642 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.489801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.489973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.490133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.490326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.490492 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.490741 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.491022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.491187 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.491340 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.491501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.491661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.491856 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.492064 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.492243 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.492408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.492559 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.492710 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.492881 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.493041 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.493195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.493352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.493504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.493678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.493839 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.493839 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.494150 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.494314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.494477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.494655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.494814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.494980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.495133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.495293 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.495445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.495599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.495764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.495917 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.496081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.496252 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.496406 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.496558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.496719 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.496872 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.497024 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.497184 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.497337 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.497503 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.497655 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.498342 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.498547 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.498736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.498901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.499140 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.499295 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.499447 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.499598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.499766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.499927 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.500095 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.500256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.500256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.500545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.500545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.500843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.500843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.501307 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.501467 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.501629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.501793 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.501955 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.502108 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.502259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.502410 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.502563 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.502774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.502938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.503107 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.503260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.503418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.503571 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.503722 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.503885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.504045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.504206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.504472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.504641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.504803 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.504994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.505161 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.505334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.505496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.505674 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.505850 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.506013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.506166 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.506319 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.506471 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.506471 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.506815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.506815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.507107 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.507259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.507430 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.507591 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.507753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.507907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.508067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.508227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.508379 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.508538 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.508708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.508870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.509022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.509174 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.509343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.509505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.509665 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.509825 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.509978 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.510129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.510129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.510436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.510436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.510827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.510999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.511152 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.511315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.511659 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.511819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.511981 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.512143 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.512295 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.512454 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.512636 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.512791 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.512942 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.513115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.513279 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.513432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.513432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.514386 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.514386 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.514697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.514697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.515025 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.515178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.515354 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.515521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.515682 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.515841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.516026 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.516196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.516350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.516537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.516704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.516864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.516864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.517172 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.517334 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.517496 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.517649 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.517801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.517960 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.518137 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.518300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.518477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.518670 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.518854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.519015 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.519168 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.519347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.519502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.519661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.519813 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.519976 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.520167 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.520336 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.520336 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.520665 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.520819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.520979 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.521131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.521306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.521477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.521650 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.521921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.522088 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.522253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.522436 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.522592 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.522790 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.522956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.523108 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.523269 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.523431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.523593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.523593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.523908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.524072 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.524231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.524383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.524543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.524704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.524866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:48:56.525031 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.525190 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.525343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.525505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.525674 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.525828 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.525990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.526150 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.526311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.526471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.526737 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.526899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.527062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.527226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.527378 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.527530 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.527695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.527849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.528000 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.528161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.528322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.528482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.528717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.528880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.529040 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.529258 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.529412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.529573 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.529726 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.529878 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.530029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.530029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.530325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.530325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.530648 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.530807 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.530971 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.531134 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.531314 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.531485 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.531638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.531791 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.531962 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.532243 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.532409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.532574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.532727 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.532879 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.533031 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.533182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.533357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.533518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.533680 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.533833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.533995 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.534147 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.534311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.534464 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.534615 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.534824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.534977 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.535138 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.535304 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.535475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.535634 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.535797 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.535949 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.535949 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.536256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.536409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.536568 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.536728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.536879 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.537040 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.537193 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.537343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.537503 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.537655 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.537817 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.537981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.538134 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.538294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.538446 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.538597 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.538837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.539001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.539161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.539322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.539475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.539643 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.539796 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.539956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.540109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.540260 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.540422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.540583 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.540745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.540897 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.541049 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.541217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.541375 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.541536 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.541713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.541867 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.542019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.542169 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.542436 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.542597 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.542796 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.542954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.543115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.543275 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.543428 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.543579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.543755 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.543916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.544076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.544236 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.544395 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.544563 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.544743 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.544908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.545060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.545212 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.545370 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.545710 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.545871 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.546037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.546190 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.546350 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.546511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.546702 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.546871 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.547024 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.547184 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.547338 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.547491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.547652 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.547806 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.547903 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.547986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548284 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548840 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.548950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549061 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549171 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549281 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549404 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549404 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549612 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549612 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549905 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.549905 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.550174 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.550301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.550420 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.550568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.550568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.550797 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.550880 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.551136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.551245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.551452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.551548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.551776 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.551871 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.552092 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.552217 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.552433 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.552583 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.552764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.552868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.553035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.553130 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.553346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.553440 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.553658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.553760 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.553990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.554090 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.554306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.554422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.554617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.554799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.554969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.555063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.555300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.555404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.555631 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.555723 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.555942 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.556042 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.556266 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.556407 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.556609 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.556898 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.556998 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.557215 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.557577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.557792 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.557914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.558144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.558247 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.558430 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.558782 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.559104 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.559206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.559423 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.559524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.559738 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.559846 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.560058 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.560161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.561045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.561158 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.561317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.561770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.561937 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.562087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.562219 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.562354 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.562502 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.562748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.562886 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.562982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.563057 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.563136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.563223 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.563298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.563492 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.563585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.563860 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.563959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.564179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.564263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.564508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.564662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.564834 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.564927 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.565159 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.565252 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.565475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.565567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.565797 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.565897 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.566121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.566224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.566433 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.566599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.566891 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.567100 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.567243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.567518 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.567740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.567836 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.568075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.568180 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.568413 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.568515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.568729 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.568830 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.569053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.569241 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.569373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.569504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.569659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.569761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.569970 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.570114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.570299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.570423 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.570614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.570965 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.571123 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.571351 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.571661 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.571987 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.572245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.572416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.572580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.572736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.572888 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.573041 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.573240 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.573406 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.573570 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.573737 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.573890 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.574041 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.574201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.574354 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.574516 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.574696 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.574855 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.575047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.575215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.575378 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.575531 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.575683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.575846 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.576075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.576799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.576993 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.577538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.577711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.577874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.578037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.578197 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.578359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.578513 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.578691 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.578852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.579038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.579198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.579386 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.579604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.579847 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.580082 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.580301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.580301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.580765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.580997 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.581239 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.581635 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.581892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.582136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.582373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.582594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.582856 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.583089 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.583323 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.583555 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.583764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.583968 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.584191 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.584414 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.584637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.584879 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.585095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.585321 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.585541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.585772 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.586019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.586256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.586489 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.586773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.587067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.587726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.587988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.587988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.588425 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.588656 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.588897 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.589146 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.589398 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.589640 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.589874 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.590108 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.590330 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.590569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.590905 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.591130 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.591367 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.591590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.591835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.592019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.592176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.592374 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.592374 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.592748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.592912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.593076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.593246 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.593408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.593561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.593726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.593726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.594031 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.594186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.594338 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.594489 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.594674 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.594835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.595000 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.595162 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.595322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.595483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.595635 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.595813 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.595967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.596129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.596289 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.596456 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.596608 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.596769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.596930 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.597131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.597291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.597291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.597291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.597291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.598218 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.598426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.598585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.598801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.598801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.599132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.599285 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.599437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.599589 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.599747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.599910 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.600064 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.600234 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.600387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.600538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.600698 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.600860 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.601027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.601182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.601333 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.601494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.601646 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.601824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.601824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.602229 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.602402 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.602565 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.602764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.602920 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.603081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.603236 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.603397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.603551 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.603711 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.603865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.604024 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.604177 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.604416 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.604583 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.604743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.604903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.605056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.605207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.605373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.605525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.605525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.605814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.605965 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.606116 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.606278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.606440 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.606611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.606789 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.606942 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.607154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.607373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.607531 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.607734 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.608234 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.608398 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.608563 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.608719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.608719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.609042 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.609042 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.609345 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.609510 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.609663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.609824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.609976 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.610128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.610290 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.610489 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.610724 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.610902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.611056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.611266 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.611481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.611684 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.611898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.612120 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.612463 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.612691 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.612920 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.613127 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.613322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.613485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.613640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.613821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.613821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.614130 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.614291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.614473 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.614703 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.614885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.615048 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.615243 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.615461 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.615638 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.615794 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.615980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.616134 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.616296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.616449 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.616610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.616772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.616927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.617079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.617297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.617457 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.617617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.617786 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.617960 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.618461 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.618657 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.618833 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.619000 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.619162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.619325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.619486 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.619486 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.619793 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.619954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.620120 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.620280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.620445 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.620445 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.620761 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.620925 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.621086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.621086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.621377 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.621529 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.621695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.621847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.622008 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.622008 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.622315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.622598 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.623342 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.623600 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.623764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.623917 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.624069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.624238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.624393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.624546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.624706 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.624860 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.625019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.625186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.625360 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.625515 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.625677 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.625838 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.625998 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.626170 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.626331 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.626484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.626656 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.626816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.626986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.627141 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.627345 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.627539 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.627694 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.627854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.628017 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.628171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.628637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.628801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.628955 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.629115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.629115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.629506 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.629660 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.629826 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.629987 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.630148 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.630311 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.630473 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.630705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.630878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.631040 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.631208 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.631362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.631523 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.631676 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.631836 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.631999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.632162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.632162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.632162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.632609 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.632857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.633017 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.633184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.633338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.633500 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.633654 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.633806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.633958 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.634129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.634283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.634434 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.634434 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.634434 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.634902 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.635064 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.635064 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.635355 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.635507 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.635659 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.635820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.635980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.636150 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.636302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.636462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.636622 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.636790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.636943 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.637094 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.637246 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.637445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.637611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.637775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.637928 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.638090 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.638251 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.638444 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.639510 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.639717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.639717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.640124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.640326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.640542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.640756 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.640984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.641198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.641409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.641633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.641848 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.642074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.642291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.642291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.642697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.642877 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.643124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.643298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.643461 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.643622 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.643784 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.643944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.644118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.644282 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.644434 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.644586 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.644738 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.644891 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.645058 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.645226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.645226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.645524 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.645678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.645830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.645991 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.646162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.646316 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.646468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.646619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.646913 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.647080 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.647242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.647242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.647596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.647762 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.647925 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.648079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.648079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.648399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.648551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.648703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.648870 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.649032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.649185 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.649663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.649830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.649994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.650157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.650320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.650482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.650665 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.650835 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.650997 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.651160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.651314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.651474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.651636 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.651797 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.651967 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.652121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.652273 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.652424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.652596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.652749 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.652916 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.653095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.653435 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.653604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.653759 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.653946 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.654596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.655030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.655275 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.655536 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.655746 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.655933 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.656170 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.656413 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.656670 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.656916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.657172 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.657465 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.657770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.658010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.658010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.658521 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.658748 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.658973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.659176 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.659396 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.660064 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.660316 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.660578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.660836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.661083 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.661338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.661585 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.661585 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.662078 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.662337 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.662604 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.662902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.663155 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.663420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.663839 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.664063 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.664300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.664549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.664795 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.665029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.665277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.665524 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.665757 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.666016 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.666240 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.666574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.666828 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.667046 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.667254 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.667474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.667790 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.668038 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.668283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.668526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.668762 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.669027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.669027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.669501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.671313 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.671583 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.671816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.672060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.672297 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.672554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.672802 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.673037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.673267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.673498 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.673766 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.674125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.674381 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.674652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.674916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.675171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.675427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.675671 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.675904 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.676124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.676352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.676567 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.676809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.677069 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.677322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.677570 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.677756 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.678076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.678329 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.678537 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.678853 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.679091 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.679272 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.679509 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.679755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.679937 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.680106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.680260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.680424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.680424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.680753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.680753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.682073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.682259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.682686 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.682864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.683037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.683191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.683359 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.683512 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.683664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.683831 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.683995 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.684279 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.684488 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.684660 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.684830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.684986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.685145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.685308 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.685532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.686212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.686377 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.686533 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.686725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.686897 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.687051 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.687205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.687370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.687532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.687685 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.687836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.688053 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.688244 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.688399 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.688561 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.688721 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.688883 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.689036 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.689199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.689353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.689513 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.689675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.689837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.689989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.690156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.690330 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.690485 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.690485 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.690827 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.690992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.691182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.691182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.691639 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.691795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.691795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.692381 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.692636 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.692636 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.692956 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.693118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.693118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.693436 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.693598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.693761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.693916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.694069 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.694222 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.694542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.694728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.694885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.695050 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.695217 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.695380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.695534 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.695693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.695846 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.695998 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.696158 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.696321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.696475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.696628 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.696781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.696932 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.697098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.697269 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.697423 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.697584 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.697739 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.697891 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.698051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.698274 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.698443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.698606 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.698827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.698981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699157 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699319 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:48:56.699482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.699482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.700643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.700643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.700643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.700643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.700643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.700643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.700643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.700643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.702063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.702063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.702063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.702063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.702063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.702063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.702063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.702063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.703556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.703556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.703556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.703556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.703556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.703556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.703556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.704710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.704710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.704710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.704710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.704710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.704710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.704710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.704710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.705973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.705973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.705973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.705973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.705973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.705973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.705973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.705973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.707234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.707234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.707234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.707234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.707234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.707234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.707234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.707234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.708462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.708462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.708462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.708462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.708462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.708462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.708462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.708462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.709644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.709644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.709644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.709644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.709644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.709644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.709644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.709644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.710859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.710859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.710859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.710859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.710859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.710859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.710859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.710859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.712208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.712208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.712208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.712208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.712208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.712208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.712208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.712208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.713677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.713677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.713677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.713677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.713677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.713677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.713677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.713677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.715011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.715011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.715011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.715011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.715011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.715011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.715011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.716030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.716030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.716030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.716480 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.716480 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.717043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.717384 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.717989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.718388 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.719317 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.719864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.720594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.720594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.720918 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.722579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.722579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.722579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.722579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.723580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.723580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.723580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.724020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.724020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.724341 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.724551 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.724917 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.725177 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.725493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.725809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.726130 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.726456 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.726850 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.727182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.727506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.727827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.728151 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.728486 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.728776 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.729091 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.729406 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.729957 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.730220 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.730549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.731020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.731478 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.731801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.732901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.733393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.733673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.734014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.734350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.734740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.735061 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.735351 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.735693 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.736047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.736388 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.736721 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.737033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.737348 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.737662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.737982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.738301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.738618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.738971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.739282 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.739599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.740135 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.740371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.740687 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.740997 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.741313 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.741621 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.741932 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.742241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.742548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.742882 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.743193 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.743622 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.743805 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.744109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.744418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.744730 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.745039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.745394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.745736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.746065 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.746395 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.746748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.747086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.747401 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.747733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.748129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.748460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.748821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.749247 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.749588 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.749904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.750554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.750805 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.751125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.751442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.751786 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.752120 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.752462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.752800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.753267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.753446 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.753884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.754071 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.754401 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.754743 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.755065 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.755446 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.755694 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.756015 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.756337 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.756651 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.756969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.757296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.757618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.757956 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.758355 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.758617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.758978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.759314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.759673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.759991 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.760702 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.760883 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.761134 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.761457 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.761770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:48:56.762018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:48:56.838124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO dbcounter [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Registered counter for database nova_api Aug 05 19:48:56.859975 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_db.sqlalchemy.engines [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:48:56.866936 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writer thread running {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:48:56.916603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO dbcounter [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Registered counter for database nova_api Aug 05 19:48:56.925823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.context [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d86af12a-bae6-4132-ab5c-5ddefc8a0b0e(cell1) {{(pid=124552) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 19:48:56.929944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:48:56.930435 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:48:56.932077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:48:56.933086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:48:56.933542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:48:56.936004 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:48:56.939094 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO dbcounter [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Registered counter for database nova_cell0 Aug 05 19:48:56.940362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_db.sqlalchemy.engines [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:48:56.943415 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO dbcounter [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Registered counter for database nova_cell1 Aug 05 19:48:56.947544 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writer thread running {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:48:56.950823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_db.sqlalchemy.engines [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:48:56.953095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_db.sqlalchemy.engines [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:48:56.959187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writer thread running {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:48:56.961289 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writer thread running {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:48:57.010233 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.context [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d86af12a-bae6-4132-ab5c-5ddefc8a0b0e(cell1) {{(pid=124553) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 19:48:57.014581 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:48:57.015094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:48:57.016738 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:48:57.017491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:48:57.017944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:48:57.020013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:48:57.022136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO dbcounter [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Registered counter for database nova_cell0 Aug 05 19:48:57.026357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO dbcounter [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Registered counter for database nova_cell1 Aug 05 19:48:57.034268 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_db.sqlalchemy.engines [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:48:57.036678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_db.sqlalchemy.engines [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:48:57.041806 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writer thread running {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:48:57.044320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writer thread running {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:48:57.113485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO dbcounter [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Registered counter for database nova_cell0 Aug 05 19:48:57.120561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_db.sqlalchemy.engines [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:48:57.125920 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writer thread running {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:48:57.197951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO dbcounter [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Registered counter for database nova_cell0 Aug 05 19:48:57.204925 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_db.sqlalchemy.engines [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:48:57.209599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writer thread running {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:48:57.478809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: WARNING keystonemiddleware.auth_token [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:48:57.484256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: WARNING keystonemiddleware.auth_token [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:48:57.546168 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: WARNING keystonemiddleware.auth_token [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:48:57.558517 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: WARNING keystonemiddleware.auth_token [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:48:57.855678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: WARNING keystonemiddleware.auth_token [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:48:57.863425 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: WARNING keystonemiddleware.auth_token [None req-a65a56bb-c86a-41a6-b79f-91b813242ce8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:48:57.869863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561fc06a29c0 pid: 124552 (default app) Aug 05 19:48:57.915626 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: WARNING keystonemiddleware.auth_token [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:48:57.922490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: WARNING keystonemiddleware.auth_token [None req-fa421063-8d5b-47d1-9e40-e8b5fc5ab329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:48:57.930100 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561fc06a29c0 pid: 124553 (default app) Aug 05 19:49:35.243114 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=3 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:49:35.245406 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=3 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:49:35.246438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=3 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:49:35.248905 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=3 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:49:36.868718 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c7bad245-4720-4fb8-8c45-9070227243fa tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Action: 'create', calling method: .version_select at 0x7f18c9894dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1756583939", "metadata": {"Type": "work"}}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c7bad245-4720-4fb8-8c45-9070227243fa tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Request method failure captured: Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 122 Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRPhER5xV9zQp6pu-uE6Q4Y5_m0X7Ye4aKCudjRpqImBEknF8HCVB_hzWKy3BYM_7fGflGjVyPrU8cKSzfMh86H-GVoxoLS_XbPy0XkpqEFpIeo5jtfL2CPNHnDx5n9jyhgN97TO-T4uJXOWNsnpka6qSokz4wPFh_zb2CWS2cxyq4 Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:49:36.882522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c374be6333184ae3900d8c4dd4717101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}] Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 899fd8ee4c614bec8ec709463b3e3b87 Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1756583939", "metadata": {"Type": "work"}}} Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: Aug 05 19:49:36.884426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1756583939', 'metadata': {'Type': 'work'}}}} Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise error Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:49:36.885515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 19:49:36.887047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 19:49:36.888494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 19:49:36.888494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:36.888494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c7bad245-4720-4fb8-8c45-9070227243fa tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:49:36.891533 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c7bad245-4720-4fb8-8c45-9070227243fa tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.671286 Aug 05 19:49:36.892326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 1/1] 10.222.0.86 () {60 vars in 1156 bytes} [Fri Aug 5 19:49:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1678 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 05 19:49:36.907608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=3 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:49:36.910804 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=3 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:49:36.912129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=3 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:49:36.914214 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=3 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:49:37.226966 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-169a2467-0bd4-4194-b126-92123502a5b0 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Action: 'create', calling method: .version_select at 0x7f18c99009d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-608834206", "metadata": {"Type": "work"}}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-169a2467-0bd4-4194-b126-92123502a5b0 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Request method failure captured: Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 119 Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRPhER5xV9zQp6pu-uE6Q4Y5_m0X7Ye4aKCudjRpqImBEknF8HCVB_hzWKy3BYM_7fGflGjVyPrU8cKSzfMh86H-GVoxoLS_XbPy0XkpqEFpIeo5jtfL2CPNHnDx5n9jyhgN97TO-T4uJXOWNsnpka6qSokz4wPFh_zb2CWS2cxyq4 Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:49:37.234593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c374be6333184ae3900d8c4dd4717101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}] Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 899fd8ee4c614bec8ec709463b3e3b87 Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-608834206", "metadata": {"Type": "work"}}} Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: Aug 05 19:49:37.235940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-608834206', 'metadata': {'Type': 'work'}}}} Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise error Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi '0' Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:49:37.236703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 19:49:37.238039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 19:49:37.240483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 19:49:37.240483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.241637 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-169a2467-0bd4-4194-b126-92123502a5b0 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:49:37.242851 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-169a2467-0bd4-4194-b126-92123502a5b0 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.343489 Aug 05 19:49:37.243958 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 1/2] 10.222.0.86 () {60 vars in 1156 bytes} [Fri Aug 5 19:49:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 346 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 19:49:37.256324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b0711e5d-f3f5-4000-9aef-e01c4937b5f4 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Action: 'create', calling method: .version_select at 0x7f18c979e550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-932699336", "metadata": {"Type": "work"}}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b0711e5d-f3f5-4000-9aef-e01c4937b5f4 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Request method failure captured: Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 118 Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRPhER5xV9zQp6pu-uE6Q4Y5_m0X7Ye4aKCudjRpqImBEknF8HCVB_hzWKy3BYM_7fGflGjVyPrU8cKSzfMh86H-GVoxoLS_XbPy0XkpqEFpIeo5jtfL2CPNHnDx5n9jyhgN97TO-T4uJXOWNsnpka6qSokz4wPFh_zb2CWS2cxyq4 Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:49:37.260997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c374be6333184ae3900d8c4dd4717101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}] Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 899fd8ee4c614bec8ec709463b3e3b87 Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-932699336", "metadata": {"Type": "work"}}} Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: Aug 05 19:49:37.263066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-932699336', 'metadata': {'Type': 'work'}}}} Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise error Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi '' Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:49:37.264076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 19:49:37.265994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 19:49:37.267412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 19:49:37.267412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:37.268396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b0711e5d-f3f5-4000-9aef-e01c4937b5f4 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:49:37.269604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b0711e5d-f3f5-4000-9aef-e01c4937b5f4 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017438 Aug 05 19:49:37.271044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 2/3] 10.222.0.86 () {60 vars in 1156 bytes} [Fri Aug 5 19:49:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 19:49:37.287786 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b3492269-9bf3-4e54-88b0-f0d9b9051538 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Calling method '.version_select at 0x7f18ca0961f0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:49:38.429664 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-b3492269-9bf3-4e54-88b0-f0d9b9051538 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] HTTP exception thrown: Volume tempest-invalid-493101891 could not be found. Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b3492269-9bf3-4e54-88b0-f0d9b9051538 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Request method failure captured: Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-493101891 HTTP/1.1 Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRPhER5xV9zQp6pu-uE6Q4Y5_m0X7Ye4aKCudjRpqImBEknF8HCVB_hzWKy3BYM_7fGflGjVyPrU8cKSzfMh86H-GVoxoLS_XbPy0XkpqEFpIeo5jtfL2CPNHnDx5n9jyhgN97TO-T4uJXOWNsnpka6qSokz4wPFh_zb2CWS2cxyq4 Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:49:38.439335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c374be6333184ae3900d8c4dd4717101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}] Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 899fd8ee4c614bec8ec709463b3e3b87 Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Volume tempest-invalid-493101891 could not be found. Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'tempest-invalid-493101891'} Aug 05 19:49:38.440982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-493101891 could not be found. (HTTP 404) (Request-ID: req-41145e5b-c1fa-4734-be72-e4bebe94f660) Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:38.442024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 19:49:38.443951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-493101891 could not be found. Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:49:38.446277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-493101891 could not be found. Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-493101891 could not be found. Aug 05 19:49:38.448104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.453659 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b3492269-9bf3-4e54-88b0-f0d9b9051538 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Returning 404 to user: Volume tempest-invalid-493101891 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:49:38.479610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b3492269-9bf3-4e54-88b0-f0d9b9051538 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/tempest-invalid-493101891" status: 404 len: 98 microversion: 2.1 time: 1.190455 Aug 05 19:49:38.483934 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 2/4] 10.222.0.86 () {58 vars in 1215 bytes} [Fri Aug 5 19:49:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-493101891 => generated 98 bytes in 1206 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 19:49:38.502930 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d8161ddd-3f40-4140-999e-3cc80ca1c3aa tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013710 Aug 05 19:49:38.505424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 3/5] 10.222.0.86 () {58 vars in 1140 bytes} [Fri Aug 5 19:49:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 19:49:38.535256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9cc9a1fc-3c1a-426e-93ec-904240070eac tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024839 Aug 05 19:49:38.541845 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 3/6] 10.222.0.86 () {58 vars in 1137 bytes} [Fri Aug 5 19:49:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 19:49:38.552603 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b1d76e61-83d8-4093-bc6f-0bf2dbe37bf8 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Calling method '.version_select at 0x7f18c975cc10>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:49:38.962930 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-b1d76e61-83d8-4093-bc6f-0bf2dbe37bf8 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] HTTP exception thrown: Volume c0574193-f93a-482f-a9fc-11e6ef6f462e could not be found. Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b1d76e61-83d8-4093-bc6f-0bf2dbe37bf8 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Request method failure captured: Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: DELETE /compute/v2.1/os-volumes/c0574193-f93a-482f-a9fc-11e6ef6f462e HTTP/1.1 Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRPhER5xV9zQp6pu-uE6Q4Y5_m0X7Ye4aKCudjRpqImBEknF8HCVB_hzWKy3BYM_7fGflGjVyPrU8cKSzfMh86H-GVoxoLS_XbPy0XkpqEFpIeo5jtfL2CPNHnDx5n9jyhgN97TO-T4uJXOWNsnpka6qSokz4wPFh_zb2CWS2cxyq4 Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:49:38.969145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c374be6333184ae3900d8c4dd4717101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}] Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 899fd8ee4c614bec8ec709463b3e3b87 Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Volume c0574193-f93a-482f-a9fc-11e6ef6f462e could not be found. Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'c0574193-f93a-482f-a9fc-11e6ef6f462e'} Aug 05 19:49:38.970854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c0574193-f93a-482f-a9fc-11e6ef6f462e could not be found. (HTTP 404) (Request-ID: req-1a3742ff-d685-49dd-8cc8-5d31fa1f2dc4) Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:38.972121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 19:49:38.973866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c0574193-f93a-482f-a9fc-11e6ef6f462e could not be found. Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 19:49:38.975396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c0574193-f93a-482f-a9fc-11e6ef6f462e could not be found. Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c0574193-f93a-482f-a9fc-11e6ef6f462e could not be found. Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b1d76e61-83d8-4093-bc6f-0bf2dbe37bf8 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Returning 404 to user: Volume c0574193-f93a-482f-a9fc-11e6ef6f462e could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b1d76e61-83d8-4093-bc6f-0bf2dbe37bf8 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/c0574193-f93a-482f-a9fc-11e6ef6f462e" status: 404 len: 109 microversion: 2.1 time: 0.423663 Aug 05 19:49:38.977081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 4/7] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:49:38 2022] DELETE /compute/v2.1/os-volumes/c0574193-f93a-482f-a9fc-11e6ef6f462e => generated 109 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:49:38.982265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7a5fbf76-381a-490a-ae8b-90d9610a6b21 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Calling method '.version_select at 0x7f18c96cb1f0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:49:39.036915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-7a5fbf76-381a-490a-ae8b-90d9610a6b21 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] HTTP exception thrown: Volume 8f668495-52b7-4104-8be3-c07054f718c5 could not be found. Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7a5fbf76-381a-490a-ae8b-90d9610a6b21 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Request method failure captured: Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/os-volumes/8f668495-52b7-4104-8be3-c07054f718c5 HTTP/1.1 Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRPhER5xV9zQp6pu-uE6Q4Y5_m0X7Ye4aKCudjRpqImBEknF8HCVB_hzWKy3BYM_7fGflGjVyPrU8cKSzfMh86H-GVoxoLS_XbPy0XkpqEFpIeo5jtfL2CPNHnDx5n9jyhgN97TO-T4uJXOWNsnpka6qSokz4wPFh_zb2CWS2cxyq4 Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:49:39.039357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c374be6333184ae3900d8c4dd4717101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c374be6333184ae3900d8c4dd4717101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c374be6333184ae3900d8c4dd4717101"}]}] Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: c374be6333184ae3900d8c4dd4717101 Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesNegativeTest-145715684 Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 899fd8ee4c614bec8ec709463b3e3b87 Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesNegativeTest-145715684-project Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Volume 8f668495-52b7-4104-8be3-c07054f718c5 could not be found. Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '8f668495-52b7-4104-8be3-c07054f718c5'} Aug 05 19:49:39.040773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f668495-52b7-4104-8be3-c07054f718c5 could not be found. (HTTP 404) (Request-ID: req-7000d0bb-b20a-43f4-a96d-cbbba627b916) Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:39.041624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:49:39.043326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f668495-52b7-4104-8be3-c07054f718c5 could not be found. Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 19:49:39.044781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f668495-52b7-4104-8be3-c07054f718c5 could not be found. Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f668495-52b7-4104-8be3-c07054f718c5 could not be found. Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7a5fbf76-381a-490a-ae8b-90d9610a6b21 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] Returning 404 to user: Volume 8f668495-52b7-4104-8be3-c07054f718c5 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7a5fbf76-381a-490a-ae8b-90d9610a6b21 tempest-VolumesNegativeTest-145715684 tempest-VolumesNegativeTest-145715684-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f668495-52b7-4104-8be3-c07054f718c5" status: 404 len: 109 microversion: 2.1 time: 0.063671 Aug 05 19:49:39.045903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 4/8] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:49:38 2022] GET /compute/v2.1/os-volumes/8f668495-52b7-4104-8be3-c07054f718c5 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:49:52.477560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-743129586", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "networks": [{"uuid": "78137f94-1489-4501-ac90-06242a847373"}]}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:49:52.840441 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] validate_networks() for [('78137f94-1489-4501-ac90-06242a847373', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:49:54.297936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-744af667-6e65-484e-a528-7ec1d13a4b7a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'create', calling method: .version_select at 0x7f18ca0dfc10>, body: {"keypair": {"name": "tempest-keypair-970463766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1naxnVgNf0praHJXa0N4x9IevC9+sNKtTnlMqj6NOABaVFPjDvcb+poxxqBg0U4ymUPObX462NcviGVFRNQp662O0GtEJ2/b/dk7QPYq73MKBRZNTEq1Kc2vA94zxHwA=="}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:49:54.549645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-744af667-6e65-484e-a528-7ec1d13a4b7a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Getting quotas for project 9be735c81c7a41b8a482e8f72a71bdef. Resources: {'key_pairs'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:49:54.572130 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-744af667-6e65-484e-a528-7ec1d13a4b7a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Getting quotas for user e8f7435928a74258af5478959bd939bb and project 9be735c81c7a41b8a482e8f72a71bdef. Resources: {'key_pairs'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:49:54.768294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-744af667-6e65-484e-a528-7ec1d13a4b7a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.850105 Aug 05 19:49:54.775416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 5/9] 10.222.0.86 () {62 vars in 1200 bytes} [Fri Aug 5 19:49:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 860 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 19:49:55.696324 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a6138aa9-66c1-4a96-949c-c84730aaae26 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'create', calling method: .version_select at 0x7f18c8e12160>, body: {"keypair": {"name": "tempest-keypair-1897978087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtK+HLTklelXC9qVJa2lziyON8iixXf+SVqVk70xPvTBxh5eeaaLmnZkdoy8vblUEeZlL78L6LYhtevs7KGQBx+OF04cna69bYPlO1OR65UsMs4bQbAJBJNF4infR+8vw=="}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:49:55.766850 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-a6138aa9-66c1-4a96-949c-c84730aaae26 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Getting quotas for project 21db26f543ab4a67b932184ba810f4e9. Resources: {'key_pairs'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:49:55.788552 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-a6138aa9-66c1-4a96-949c-c84730aaae26 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Getting quotas for user 074f3ddb689c4a60a05d3267080d7e7a and project 21db26f543ab4a67b932184ba810f4e9. Resources: {'key_pairs'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:49:55.865135 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a6138aa9-66c1-4a96-949c-c84730aaae26 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.088097 Aug 05 19:49:55.865747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 6/10] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:49:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:49:58.370099 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:49:58.371775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:49:58.372445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:49:58.372890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:49:58.373309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:49:58.408886 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:49:58.409711 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:49:58.410575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:49:58.411770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:49:58.412570 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:49:58.413285 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:49:58.510997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Getting quotas for project d773fbf1acca4df9947f053573486931. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:49:58.522524 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Getting quotas for user a1d7a67f595b44a89abe80bc4f714821 and project d773fbf1acca4df9947f053573486931. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:49:58.579058 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:49:58.584566 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:49:58.755307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f6e4ea79-eabc-4463-8359-850686babf18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.616390 Aug 05 19:49:58.764939 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 5/11] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 6627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:49:58.772307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-46f87dd8-513e-4e34-a1c6-4d57b00eedc9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:49:58.773977 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-46f87dd8-513e-4e34-a1c6-4d57b00eedc9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:49:59.144915 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-46f87dd8-513e-4e34-a1c6-4d57b00eedc9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:49:59.168610 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-46f87dd8-513e-4e34-a1c6-4d57b00eedc9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1214 microversion: 2.1 time: 0.401866 Aug 05 19:49:59.182680 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 6/12] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:49:58 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1214 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:49:59.395934 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fe0bd7f9-4190-42b4-8e9c-e45a0ab9107a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: .version_select at 0x7f18c8e12820>, body: {"keypair": {"name": "tempest-keypair-1631433874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEdUAx7ZqyclSBC23B0iXB2LqkTBWBAcnB4pwN/9O32yYbef0wFKVLKUNa2ry5Jg9i04r8mGI5qJC+S96K4HYNQ23ALBUVilBWkVXWxQp8k5a04xkTew+gHDnt8CdzUOA=="}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:49:59.439175 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-fe0bd7f9-4190-42b4-8e9c-e45a0ab9107a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'key_pairs'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:49:59.451397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-fe0bd7f9-4190-42b4-8e9c-e45a0ab9107a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for user a357a3d27e4e41adae1c56ee39ae5aa7 and project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'key_pairs'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:49:59.537922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fe0bd7f9-4190-42b4-8e9c-e45a0ab9107a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.935510 Aug 05 19:49:59.540951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 7/13] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:49:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:00.193160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e0a99e9d-8d64-4d14-85b2-59abf917fb8e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:00.194438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e0a99e9d-8d64-4d14-85b2-59abf917fb8e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:00.370806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e0a99e9d-8d64-4d14-85b2-59abf917fb8e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:00.384104 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e0a99e9d-8d64-4d14-85b2-59abf917fb8e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1214 microversion: 2.1 time: 0.194376 Aug 05 19:50:00.386864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 7/14] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:00 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:01.381826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-696808277", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:01.414124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0b91c419-3fb6-4d15-bf2f-aa04be38a637 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:01.414847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0b91c419-3fb6-4d15-bf2f-aa04be38a637 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:01.552421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] validate_networks() for [('aa15076f-c074-4bfb-abe0-9aae0ed18fed', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:50:01.578512 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0b91c419-3fb6-4d15-bf2f-aa04be38a637 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:01.587402 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0b91c419-3fb6-4d15-bf2f-aa04be38a637 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1214 microversion: 2.1 time: 0.179171 Aug 05 19:50:01.601309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 8/15] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:01 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:02.164547 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1259949574", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb527552-98d6-4b05-a3cd-e58cc7214595"}], "security_groups": [{"name": "tempest-securitygroup--1863635832"}], "key_name": "tempest-keypair-970463766", "user_data": "}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:02.994144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] validate_networks() for [('cb527552-98d6-4b05-a3cd-e58cc7214595', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:50:05.687745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:50:05.688404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:50:05.688632 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:50:05.689049 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:50:05.689459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:50:05.704620 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:05.705122 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:05.705555 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:05.706294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:05.712046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:05.712646 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:05.814182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Getting quotas for project afed1554d1394cfc8abea0e6c5e15b3f. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:50:05.828404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Getting quotas for user d183fcdae86448caa81c09823dd3884e and project afed1554d1394cfc8abea0e6c5e15b3f. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:50:05.863997 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:50:05.872992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:50:05.959325 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:50:05.959921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:50:05.960224 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:50:05.960641 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:50:05.962137 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:50:06.003387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:06.003387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:06.003387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:06.010845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:06.013474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:06.015091 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:06.116962 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Getting quotas for project 9be735c81c7a41b8a482e8f72a71bdef. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:50:06.133617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Getting quotas for user e8f7435928a74258af5478959bd939bb and project 9be735c81c7a41b8a482e8f72a71bdef. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:50:06.138512 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3e8520c2-e397-4406-8c2b-ba34d3db2e9f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.518649 Aug 05 19:50:06.152070 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 8/16] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:50:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 5532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:50:06.169502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:06.171306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:06.193697 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:06.194663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:06.195317 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:06.196508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:06.203969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:06.204492 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:50:06.205035 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:06.209219 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:50:06.475118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-93dc4662-1ec1-46a6-8bd8-0aef2e74ad5d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.314774 Aug 05 19:50:06.500472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 9/17] 10.222.0.86 () {62 vars in 1188 bytes} [Fri Aug 5 19:50:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 4342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 05 19:50:06.542415 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-86c67280-233c-49cc-ac63-e6fb5a23aae9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:06.544803 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-86c67280-233c-49cc-ac63-e6fb5a23aae9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:06.974470 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-86c67280-233c-49cc-ac63-e6fb5a23aae9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:07.002863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-86c67280-233c-49cc-ac63-e6fb5a23aae9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1221 microversion: 2.1 time: 0.484643 Aug 05 19:50:07.005012 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 10/18] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:06 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1221 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:07.055462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e9107f00-1367-41ee-aa09-e8a9dd7e11ff tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:07.056813 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e9107f00-1367-41ee-aa09-e8a9dd7e11ff tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:07.502995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:07.515862 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e9107f00-1367-41ee-aa09-e8a9dd7e11ff tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:07.548584 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e9107f00-1367-41ee-aa09-e8a9dd7e11ff tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:07.565156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c4f79417-4e2d-4bba-a51f-af40d95f9fb5 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 1.405463 Aug 05 19:50:07.566565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e9107f00-1367-41ee-aa09-e8a9dd7e11ff tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:07.567321 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 9/19] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:06 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:07.571710 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e9107f00-1367-41ee-aa09-e8a9dd7e11ff tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1281 microversion: 2.20 time: 0.562540 Aug 05 19:50:07.572338 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 11/20] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:07 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1281 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:07.583259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1475875135", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:07.705877 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-740652079", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "959e8ab5-efdc-46d3-bf82-ceecf78a7830"}], "security_groups": [{"name": "tempest-securitygroup--306104443"}], "key_name": "tempest-keypair-1631433874", "user_data": "}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:07.997646 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] validate_networks() for [('aa15076f-c074-4bfb-abe0-9aae0ed18fed', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:50:08.152871 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] validate_networks() for [('959e8ab5-efdc-46d3-bf82-ceecf78a7830', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:50:08.898995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:50:08.900304 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:50:08.901039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:50:08.902181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:50:08.902865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:50:08.916430 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:08.917494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:08.918148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:08.919404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:08.920098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:08.921053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:08.954177 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Getting quotas for project afed1554d1394cfc8abea0e6c5e15b3f. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:50:08.961354 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Getting quotas for user d183fcdae86448caa81c09823dd3884e and project afed1554d1394cfc8abea0e6c5e15b3f. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:50:08.978682 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:50:08.982429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:50:09.022383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:50:09.024316 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:50:09.025123 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:50:09.025806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:50:09.027035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:50:09.062951 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:09.065362 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:09.067450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:09.069217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:09.070546 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:09.071933 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:09.076304 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9dbbb417-b52d-4c92-9d7e-a4299bf85a9e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.507783 Aug 05 19:50:09.085829 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 10/21] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:50:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:50:09.106818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:50:09.111880 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for user a357a3d27e4e41adae1c56ee39ae5aa7 and project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:50:09.118267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1869717785", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b655173a-c5d2-4f9a-9482-e2776ef4231e"}], "security_groups": [{"name": "tempest-securitygroup--1730783744"}], "key_name": "tempest-keypair-1897978087", "user_data": "}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:09.144842 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:50:09.157408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:50:09.270188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d551f52a-689d-4966-b747-8af140a99058 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.574639 Aug 05 19:50:09.291446 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 12/22] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:50:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:50:09.315601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:09.336173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:09.388649 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:09.393479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:09.403308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:09.410103 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:09.412671 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:09.419370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:09.468847 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] validate_networks() for [('b655173a-c5d2-4f9a-9482-e2776ef4231e', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:50:10.121389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:10.136187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9cbd1809-6895-4521-9c98-982243f4cff8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.838910 Aug 05 19:50:10.139593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 13/23] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:09 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:10.159331 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:10.160917 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:10.174939 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:10.175688 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:10.178230 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:10.179210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:10.181218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:10.183743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:10.287952 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:10.299662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:10.301218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:10.302348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9a358f0c-8c7a-47f7-a536-e81744ee6fd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1285 microversion: 2.20 time: 0.161480 Aug 05 19:50:10.318225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 14/24] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:10 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:10.330156 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:10.330156 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:10.338359 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:10.338921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:10.339872 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:10.340779 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:10.346068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:10.346900 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:10.441225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:10.452069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d71b65b3-f644-4841-9499-fcc1ab04c1d2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1226 microversion: 2.1 time: 0.142812 Aug 05 19:50:10.452708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 15/25] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:10 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:10.457313 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:10.458115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:10.465008 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:10.465715 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:10.466322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:10.467210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:10.467815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:10.468389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:10.614619 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:10.625203 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a22637fe-4f52-4a36-b8e2-b5445dd53c65 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1245 microversion: 2.1 time: 0.171369 Aug 05 19:50:10.631298 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 16/26] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:10 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1245 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:10.832353 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:50:10.833757 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:50:10.834459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:50:10.835268 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:50:10.836076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:50:10.855198 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:10.856642 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:10.862116 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:10.863490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:10.866955 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:10.867549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:10.983091 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Getting quotas for project 21db26f543ab4a67b932184ba810f4e9. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:50:11.001602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Getting quotas for user 074f3ddb689c4a60a05d3267080d7e7a and project 21db26f543ab4a67b932184ba810f4e9. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:50:11.027638 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:50:11.029888 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:50:11.124961 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f232f64b-f105-4591-800f-eb46c5a5f213 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.037544 Aug 05 19:50:11.126614 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 11/27] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:50:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:50:11.147676 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4e6fb021-30c7-4f97-9caa-3a3dd1aec66d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:11.148574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4e6fb021-30c7-4f97-9caa-3a3dd1aec66d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:11.174494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:11.177875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:11.205995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:11.208555 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:11.210009 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:11.211145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:11.217096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:11.218849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:11.406561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4e6fb021-30c7-4f97-9caa-3a3dd1aec66d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:11.437457 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4e6fb021-30c7-4f97-9caa-3a3dd1aec66d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1238 microversion: 2.1 time: 0.297212 Aug 05 19:50:11.439651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 17/28] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:11 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1238 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:11.453492 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:11.455708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:11.468622 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:11.469301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:11.470025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:11.472146 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:11.472799 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:11.473739 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:11.532281 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:11.539978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b721f241-6e56-42c9-9392-0d7497620356 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.382486 Aug 05 19:50:11.545768 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 12/29] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:11 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:11.557988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:11.568054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:11.575595 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:11.576084 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:11.576519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:11.585353 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:11.586110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:11.586747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:11.648575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:11.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:11.665680 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:11.667759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-71bbfb1f-5f3f-41c3-9336-0d9c9d5fd104 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1277 microversion: 2.20 time: 0.224649 Aug 05 19:50:11.687229 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 18/30] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:11 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:11.692508 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:11.693340 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:11.702295 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:11.704280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:11.704280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:11.704470 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:11.704939 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:11.705073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:11.705580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:11.717720 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d715a4e0-6ba6-4b9c-8154-6c0b12d2d31f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1226 microversion: 2.1 time: 0.169264 Aug 05 19:50:11.718314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 13/31] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:11 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1226 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:11.798496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:11.807135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6cdad3a5-4ff6-4873-8b80-d60e921ef4a4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1245 microversion: 2.1 time: 0.118024 Aug 05 19:50:11.808407 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 19/32] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:11 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:12.463472 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:12.464916 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:12.472172 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.473013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.473461 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.474480 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.475315 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.475926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.547872 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:12.556126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1e5c4ce3-700b-4649-bef4-e2512efce19a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1242 microversion: 2.1 time: 0.096524 Aug 05 19:50:12.556986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 14/33] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:12 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:12.569573 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:12.570458 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:12.578451 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.579036 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.579487 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.580343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.580802 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.581383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.699078 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:12.699723 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:12.717994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.718750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.719441 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.720364 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.721010 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.721619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.793951 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:12.802680 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b0de3f5d-7e38-44a2-aca4-b566c8e91ca4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.236807 Aug 05 19:50:12.809755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 20/34] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:12 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:12.827242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:12.828240 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:12.842840 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.843689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.844344 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.845307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.846018 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.846764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.877541 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:12.890440 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:12.892179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:12.893376 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ca9a3f67-f708-4987-a111-432fe0609339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1277 microversion: 2.20 time: 0.199675 Aug 05 19:50:12.913335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 15/35] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:12 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:12.924084 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:12.928728 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:12.953973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.962305 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.966558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.967461 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:12.970916 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:12.971474 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:12.983081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:12.995034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9a8fa2ca-1a9b-4c73-9f72-73fd40e146ba tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1226 microversion: 2.1 time: 0.183665 Aug 05 19:50:12.995995 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 21/36] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:12 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1226 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:13.112664 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:13.122784 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b535bbf0-1c33-4bb5-900f-ab1d10c71af2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1245 microversion: 2.1 time: 0.206266 Aug 05 19:50:13.124715 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 16/37] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:12 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:13.578131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:13.578799 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:13.592430 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:13.594697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:13.595206 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:13.595950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:13.600587 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:13.601134 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:13.717980 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:13.734355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-03fdde5f-819a-431c-8dcf-6069cfba0ae8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1242 microversion: 2.1 time: 0.159818 Aug 05 19:50:13.735788 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 22/38] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:13 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:13.840292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:13.840912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:13.844148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:13.881587 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:13.882512 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:13.883183 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:13.884114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:13.884795 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:13.886041 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:13.923465 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:13.924137 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:13.930367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:13.931215 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:13.932296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:13.933175 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:13.933907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:13.934482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:14.094757 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:14.111569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:14.113513 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:14.114965 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-923bec3a-088a-408a-ad01-5b225b9445b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1277 microversion: 2.20 time: 0.195393 Aug 05 19:50:14.116462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 23/39] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:13 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:14.119857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:14.128047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:14.130819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:14.130941 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b23b87ca-4837-4b5e-9eae-c536217e332e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.294076 Aug 05 19:50:14.131890 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 17/40] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:13 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:14.136213 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:14.136916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:14.137503 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:14.138366 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:14.138997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:14.139567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:14.151640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:14.158143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:14.180467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:14.184383 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:14.185052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:14.185802 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:14.187265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:14.190909 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:14.232089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:14.242674 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d78abb21-6217-4972-aab9-3f46b9cdebd1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1226 microversion: 2.1 time: 0.122835 Aug 05 19:50:14.244150 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 24/41] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:14 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:14.283782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:14.295292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b4db0a41-9148-4858-9489-f2be8c41596b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1245 microversion: 2.1 time: 0.151160 Aug 05 19:50:14.296356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 18/42] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:14 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1245 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:14.758404 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:14.759312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:14.764679 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:14.776750 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:14.777810 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:14.778248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:14.779002 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:14.779446 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:14.780119 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:14.856803 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:14.870387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a2ec38d1-84e0-4540-ae5c-3be3090dfcfb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1242 microversion: 2.1 time: 0.115997 Aug 05 19:50:14.871712 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 25/43] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:14 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:15.140441 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:15.141060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:15.155891 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:15.156513 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:15.158216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.158456 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.158978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.159823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.164099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.164099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.175974 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.176604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.177155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.178011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.178578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.179613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.250334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:15.259836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:15.263705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:15.265024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2a014f6e-e006-4bcb-aea5-5e966f3348a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1277 microversion: 2.20 time: 0.128517 Aug 05 19:50:15.265707 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 19/44] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:15 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:15.286876 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:15.288864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:15.296250 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.297296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.297996 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.299086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.299738 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.300339 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.378250 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:15.387454 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4f7385fc-f785-49db-b9ad-34a0656f84ad tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1226 microversion: 2.1 time: 0.119363 Aug 05 19:50:15.390826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 20/45] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:15 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:15.405154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:15.406241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:15.407196 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:15.416155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6cb436a7-bfb2-428b-88be-de4c76665b43 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.265851 Aug 05 19:50:15.417660 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 26/46] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:15 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:15.418159 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.419241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.420176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.421415 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.422194 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.422901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.522585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:15.532522 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9feb992a-8b82-42f0-88ce-4b22f3efd152 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1245 microversion: 2.1 time: 0.140017 Aug 05 19:50:15.545716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 21/47] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:15 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:15.891723 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:15.894658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:15.909765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.911334 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.913385 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:15.916745 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:15.919676 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:15.921802 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.016962 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:16.025529 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dd7a45f2-0bf9-421e-8cf0-096db79f3e36 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1242 microversion: 2.1 time: 0.137600 Aug 05 19:50:16.026283 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 27/48] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:15 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:16.290173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:16.290912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:16.299541 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:16.300368 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:16.300950 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.301808 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:16.302580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:16.303190 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.397757 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:16.409695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:16.410329 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:16.411660 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:16.413508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:16.414705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-94037caa-3c21-4084-855e-5aa4ee58b0bb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1277 microversion: 2.20 time: 0.129412 Aug 05 19:50:16.415771 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 22/49] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:16 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:16.421829 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:16.430758 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:16.432609 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.435010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:16.445885 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:16.446755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.459314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:16.462593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:16.487506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:16.488160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:16.492076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.496706 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:16.498226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:16.499624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.569668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:16.580320 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-212b5bb4-4a84-4d42-b8cf-575b1eff655b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1226 microversion: 2.1 time: 0.175272 Aug 05 19:50:16.580985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 28/50] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:16 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1226 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:16.594365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:16.606839 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:16.628333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:16.634319 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:16.636985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.639005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:16.640905 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:16.643365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:16.748947 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=100 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:16.853136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:16.870396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-985f1da5-ce0d-4357-aece-93344ca998f6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1245 microversion: 2.1 time: 0.286150 Aug 05 19:50:16.880579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 29/51] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:16 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1245 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:17.079527 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:17.084232 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:17.084343 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:17.093626 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a2a33795-6c60-4e37-bbd3-d72b96df92e6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.657248 Aug 05 19:50:17.095393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 23/52] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:16 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:17.110207 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:17.111222 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:17.112369 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:17.114563 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:17.122185 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:17.171128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:17.334157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:17.346373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d0d11aae-f264-4c68-adc5-11769a695483 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1242 microversion: 2.1 time: 0.299231 Aug 05 19:50:17.347217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 30/53] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:17 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1242 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:17.455169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:17.456500 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:17.480558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:17.490429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:17.491774 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:17.495119 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:17.496869 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:17.499534 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:17.619451 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:17.621494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:17.645094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:17.657804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:17.660775 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:17.662687 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:17.663568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:17.666912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:17.667485 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:17.668886 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7cec849a-0e67-43b6-a612-176f69a39616 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1277 microversion: 2.20 time: 0.228001 Aug 05 19:50:17.670229 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:17.673324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:17.690114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 24/54] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:17 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:17.846385 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:17.854756 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9992d346-ba10-4458-bbae-5b3c34e993ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1218 microversion: 2.1 time: 0.250679 Aug 05 19:50:17.866309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 31/55] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:17 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1218 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:17.905188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:17.906066 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:17.923854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:17.925103 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:17.928016 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:17.929023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:17.930785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:17.934950 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.029095 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:18.044152 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ed0ad8bd-1d45-4e70-be03-a847c561a07a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1237 microversion: 2.1 time: 0.145378 Aug 05 19:50:18.046200 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 25/56] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:17 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1237 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:18.117403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:18.119069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:18.127928 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:18.128809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:18.129407 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.130267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:18.131000 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:18.131575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.369059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:18.370726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:18.378820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:18.380413 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:18.380860 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.381569 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:18.382453 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:18.382945 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.411079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:18.426783 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-37511f9f-fc57-47df-8813-e87c1c24adac tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.313080 Aug 05 19:50:18.438077 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:18.438684 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 32/57] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:18 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:18.530548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:18.554093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-30a6a75b-51f3-4fe2-9e9f-9b4dda7d2e76 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1290 microversion: 2.1 time: 0.189525 Aug 05 19:50:18.559192 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 26/58] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:18 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1290 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:18.697601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:18.698970 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:18.712048 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:18.716537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:18.717135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.718055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:18.720874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:18.722026 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.896467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:18.897265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:18.907170 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:18.907972 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:18.908711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.910415 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:18.911638 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:18.912714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:18.996947 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:19.016089 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:19.021302 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:19.031452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:19.033291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0133c3fc-0dcb-4403-9636-5a6be622f8db tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1333 microversion: 2.20 time: 0.339573 Aug 05 19:50:19.033662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-10527cae-4e11-4042-991a-09282d802cf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1274 microversion: 2.1 time: 0.141883 Aug 05 19:50:19.034184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 33/59] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:18 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1333 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:19.034736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 27/60] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:18 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:19.092129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:19.093276 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:19.102436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=6 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:19.107852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.109365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.109788 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.110889 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.111578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.112279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.216073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:19.231550 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c475a573-64dc-4204-a98f-0d253ea0d93f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1293 microversion: 2.1 time: 0.162043 Aug 05 19:50:19.232728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 34/61] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:19 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:19.289960 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-b179a518-cbf8-40c9-b26c-5e9867c05ef1 req-8357171d-37c8-49f3-bf7e-dfd234ff29ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ae4231-a7c2-485b-82c8-bdc75570832b", "tag": "4f490d8a-26d1-4800-889b-5b34f349c42f"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:19.302761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b179a518-cbf8-40c9-b26c-5e9867c05ef1 req-8357171d-37c8-49f3-bf7e-dfd234ff29ac service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.303238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b179a518-cbf8-40c9-b26c-5e9867c05ef1 req-8357171d-37c8-49f3-bf7e-dfd234ff29ac service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.303716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b179a518-cbf8-40c9-b26c-5e9867c05ef1 req-8357171d-37c8-49f3-bf7e-dfd234ff29ac service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.323810 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-b179a518-cbf8-40c9-b26c-5e9867c05ef1 req-8357171d-37c8-49f3-bf7e-dfd234ff29ac service nova] Creating event network-changed:4f490d8a-26d1-4800-889b-5b34f349c42f for instance 13ae4231-a7c2-485b-82c8-bdc75570832b on hv-cinder-85220 Aug 05 19:50:19.324099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b179a518-cbf8-40c9-b26c-5e9867c05ef1 req-8357171d-37c8-49f3-bf7e-dfd234ff29ac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 19:50:19.324564 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b179a518-cbf8-40c9-b26c-5e9867c05ef1 req-8357171d-37c8-49f3-bf7e-dfd234ff29ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=124553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 19:50:19.325529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.325984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.326409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.327147 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.327626 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.328044 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.337822 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.compute.rpcapi [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 19:50:19.338780 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] Releasing lock "compute-rpcapi-router" {{(pid=124553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 19:50:19.353663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-36daf655-2052-47af-9dae-13396c4b0722 None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161270 Aug 05 19:50:19.354366 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 28/62] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:19.459445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:19.460057 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:19.466800 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.467286 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.468745 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.468745 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.469009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.469442 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.580326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:19.581171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:19.590058 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.590988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.591753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.592889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:19.593896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:19.594892 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:19.662063 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:19.676074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6bdc8178-46a4-4921-9c94-a8b87fb24f06 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.220308 Aug 05 19:50:19.688137 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 35/63] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:19 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:19.690599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:19.700259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ddf6192e-831c-48ef-9846-77b4e09099bb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1290 microversion: 2.1 time: 0.124155 Aug 05 19:50:19.701145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 29/64] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:19 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:20.064008 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:20.064618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:20.070764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.071245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.071677 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.072393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.073560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.073999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.081670 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:20.082310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:20.095380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.095380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.095380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.095380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.095703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.095703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.160024 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:20.166104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:20.175722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9d97310f-38dc-4f66-ab81-a18fb1f33b7a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1274 microversion: 2.1 time: 0.098435 Aug 05 19:50:20.176317 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 30/65] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:20 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:20.184971 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:20.187388 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:20.189071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a8b5564d-b8b6-4c77-aeff-ced94984baf1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1341 microversion: 2.20 time: 0.128921 Aug 05 19:50:20.189743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 36/66] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:20 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1341 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:20.254176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:20.255452 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:20.269192 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.269712 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.270166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.273647 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.274156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.274729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.407971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:20.418846 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-cbedef6c-efd7-4a08-9863-6ff092f232d5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1293 microversion: 2.1 time: 0.169633 Aug 05 19:50:20.419735 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 31/67] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:20 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1293 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:20.699556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:20.700207 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:20.706666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.706666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.706922 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.707605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.708233 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.708628 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.729447 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:20.730183 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:20.736419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.736918 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.737354 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.738229 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:20.738716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:20.739150 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:20.818539 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:20.831818 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-92462169-ad8b-483b-9566-c93b37c34a04 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1290 microversion: 2.1 time: 0.106264 Aug 05 19:50:20.832493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 32/68] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:20 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:20.861710 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:20.871907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c63a131b-bf51-42f2-a3af-9e4cc38caefd tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.177158 Aug 05 19:50:20.872733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 37/69] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:20 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:21.210822 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:21.211543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:21.213641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=30 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:21.219801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.220316 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.220896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.221615 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.222069 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.222495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.228128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:21.228746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:21.235475 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.235904 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.236375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.237790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.238419 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.239272 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.299524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:21.309331 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ef232908-d437-469e-923d-e57cb1308fc6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1274 microversion: 2.1 time: 0.102978 Aug 05 19:50:21.311094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 33/70] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:21 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:21.312074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:21.320465 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:21.322182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:21.323689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3ba7f11c-86ae-4724-80f0-9d79b8cb4ac0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1351 microversion: 2.20 time: 0.099684 Aug 05 19:50:21.324245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 38/71] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:21 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:50:21.441975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:21.442597 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:21.448709 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.449206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.449667 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.450551 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.451054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.451629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.519183 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:21.529550 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-190e29cf-a8de-411c-ae87-45f338408644 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1293 microversion: 2.1 time: 0.091478 Aug 05 19:50:21.530519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 34/72] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:21 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:21.852477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:21.853172 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:21.855746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=30 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:21.861494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.862022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.862497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.863262 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.863724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.864186 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.895048 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:21.896327 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:21.904401 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.905151 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.906467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.907383 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:21.907925 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:21.908370 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:21.946926 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:21.955474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-21c8e348-f6fd-43ec-8958-3cd863eff252 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1290 microversion: 2.1 time: 0.106989 Aug 05 19:50:21.958841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 39/73] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:21 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:22.071926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:22.080723 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2123c846-ccc4-49c4-8af6-3e57364990e0 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.190026 Aug 05 19:50:22.081306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 35/74] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:21 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:22.330155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:22.330804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:22.336855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:22.337793 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:22.338601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:22.339401 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:22.340323 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:22.340917 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:22.346408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:22.347122 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:22.353419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:22.354538 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:22.355262 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:22.356245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:22.356933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:22.357628 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:22.409944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:22.417990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-81882929-0975-44f3-850b-4e49eb3f6cec tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1274 microversion: 2.1 time: 0.091642 Aug 05 19:50:22.418751 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 40/75] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:22 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:22.425135 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:22.434300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:22.435864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:22.437013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0bb1d717-ebda-4226-b7d6-9cd3dddf7be6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1351 microversion: 2.20 time: 0.094943 Aug 05 19:50:22.437563 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 36/76] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:22 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:22.553132 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:22.554049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:22.562139 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:22.562645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:22.563106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:22.563811 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:22.564293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:22.564702 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:22.627729 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:22.636051 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-30ff7912-3334-415b-9d99-faf57a31c301 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1293 microversion: 2.1 time: 0.086177 Aug 05 19:50:22.637155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 41/77] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:22 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:22.988427 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:22.989235 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:22.997959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:22.998347 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.000113 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.001235 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.005116 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.006221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.102074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:23.102918 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:23.112205 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.114349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.114983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.116092 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.117245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.117843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.435899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:23.470899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-aa33a1ec-2e17-4e76-9346-d830e63a5da7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1290 microversion: 2.1 time: 0.492622 Aug 05 19:50:23.492180 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 37/78] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:22 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1290 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:23.526542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:23.527849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:23.536954 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.537849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.538446 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.539374 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.540613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.541320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.720891 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:23.734908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-08e015d7-9182-47b8-8ec5-c0e17061b600 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1292 microversion: 2.1 time: 0.232348 Aug 05 19:50:23.735645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 38/79] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:23 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1292 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:23.743016 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:23.743985 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:23.765177 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.766932 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.768908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.770081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.770818 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.771914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.786526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:23.794264 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-66c76e6e-9296-4617-a967-52288ee1c3e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.696011 Aug 05 19:50:23.808105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 42/80] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:23 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:23.816897 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:23.818985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:23.826101 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.826853 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.827459 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.828311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:23.828909 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:23.829495 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:23.878567 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:23.888585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:23.892137 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:23.893598 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4b6b383f-809b-41d3-b8b4-a574eaf6d4ea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1339 microversion: 2.20 time: 0.156079 Aug 05 19:50:23.894377 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 39/81] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:23 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:24.045549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:24.071804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-825a79bf-df0f-4eae-847d-c9666c0dab14 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1299 microversion: 2.1 time: 0.262016 Aug 05 19:50:24.090551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 43/82] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:23 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:24.511687 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:24.525034 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:24.562313 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:24.563419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:24.568146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:24.569601 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:24.571492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:24.576505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:24.749251 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:24.759507 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:24.762349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:24.764804 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8ce059e4-1df2-4751-b29f-432277617bd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1296 microversion: 2.1 time: 0.258635 Aug 05 19:50:24.766659 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 40/83] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:24 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1296 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:24.772348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:24.773673 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:24.774561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:24.776790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:24.777920 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:24.778907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:24.816535 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:24.817468 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:24.828786 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:24.833644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:24.834110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:24.835001 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:24.839678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:24.840128 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:24.908909 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:24.927659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-52107809-9d4f-42af-ae59-67072032b607 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1280 microversion: 2.1 time: 0.174756 Aug 05 19:50:24.935117 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 44/84] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:24 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:24.950154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:24.952332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:24.965290 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:24.967277 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:24.968030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:24.969007 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:24.975357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:24.975807 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:25.115220 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:25.126152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:25.132667 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:25.133312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-810528b7-41bf-4200-b20d-9a9508c45abd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1339 microversion: 2.20 time: 0.196448 Aug 05 19:50:25.147136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 45/85] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:24 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1339 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:25.153950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:25.154567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:25.160764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:25.161260 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:25.161691 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:25.162395 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:25.163344 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:25.164195 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:25.169892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=100 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:25.270122 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:25.281832 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dec31cb8-3f71-428f-b6e8-85787d590d29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1299 microversion: 2.1 time: 0.133059 Aug 05 19:50:25.282443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 46/86] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:25 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:25.339488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:25.345484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c842fe06-9276-4f8d-90e4-82c7f37b43e4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.533656 Aug 05 19:50:25.347306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 41/87] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:24 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:25.792595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:25.793339 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:25.809403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:25.811388 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:25.812226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:25.815099 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:25.816038 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:25.818266 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:25.953090 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:25.953734 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:25.962908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:25.964263 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:25.964970 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:25.966102 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:25.966777 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:25.967362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:26.150941 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:26.163237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0e527727-e6c1-4fe9-a44e-f8635da2b7fc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.214722 Aug 05 19:50:26.164187 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 42/88] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:25 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:26.169764 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:26.170811 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:26.178375 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:26.179148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:26.179797 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:26.181008 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:26.182948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:26.183613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:26.210757 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:26.327062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:26.337268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7a8c1f36-051a-4418-b8dd-9c5dd533ec1e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.552994 Aug 05 19:50:26.339252 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 47/89] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:25 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:26.348658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:26.349371 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:26.364923 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:26.365411 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:26.365854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:26.366563 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:26.367050 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:26.367479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:26.413735 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:26.429954 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:26.434921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:26.436433 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4c7356ef-c79b-473c-b178-9816881e652d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.271245 Aug 05 19:50:26.437853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 43/90] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:26 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:26.443254 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:26.444333 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:26.455545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:26.456047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:26.456541 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:26.457610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:26.458079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:26.458511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:26.646531 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:26.655834 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-49dbb120-6fd4-40db-bfad-72a1bc7965a4 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.216563 Aug 05 19:50:26.669007 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 44/91] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:26 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:26.670037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:26.678025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ad3b40ab-256c-4b48-ac8f-bd93a3854d73 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.337739 Aug 05 19:50:26.678594 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 48/92] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:26 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:27.193365 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:27.194134 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:27.201061 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:27.201761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:27.202205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:27.202940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:27.203396 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:27.203824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:27.362161 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:27.362776 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:27.375713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:27.376217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:27.376651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:27.377361 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:27.377817 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:27.378241 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:27.506383 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:27.521853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9d25fdf8-b3ab-41d7-8ea8-d9f55d4c8c34 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.335084 Aug 05 19:50:27.525572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 45/93] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:27 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:27.532538 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:27.533667 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:27.555742 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:27.557940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:27.558711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:27.559668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:27.560507 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:27.561334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:27.939777 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:27.952144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8c97fdb2-8478-49ef-94f6-9ffffc761b35 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.594912 Aug 05 19:50:27.952991 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 49/94] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:27 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:27.958242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:27.959105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:27.967699 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:27.968605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:27.969204 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:27.970348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:27.971353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:27.971940 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:28.069759 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:28.080191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:28.081996 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:28.083205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-91fd14bf-c0d6-41a9-aaf5-4bc63a9101ac tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.555614 Aug 05 19:50:28.084326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 46/95] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:27 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:28.092221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:28.093183 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:28.100456 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:28.102113 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:28.102611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:28.103766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:28.105200 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:28.105409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:28.391132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:28.402016 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-656cb316-1ace-4c86-873b-27af0551698d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.316205 Aug 05 19:50:28.403288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 47/96] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:28 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:28.551637 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:28.553413 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:28.557681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:28.566247 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:28.569083 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:28.570081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:28.571024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:28.571641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:28.572454 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:28.577170 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-bb82de1b-f46a-4166-ab07-9218eec3ab1c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.621770 Aug 05 19:50:28.593438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 50/97] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:27 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:28.976958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:28.977198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:28.991982 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:28.993801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:28.996129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:28.997966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:28.998682 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:28.999347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:29.008403 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:29.027695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5b2b55d5-d78a-491b-96e9-f98090884eb5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.481966 Aug 05 19:50:29.040341 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 48/98] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:28 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:29.108724 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:29.109425 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:29.116241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:29.117111 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:29.117547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:29.118466 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:29.120638 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:29.121411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:29.335405 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=8 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:29.380145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:29.395035 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:29.399702 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:29.404283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9a693917-8d71-4f74-aa3f-f6fe414337d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.299328 Aug 05 19:50:29.407946 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 49/99] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:29 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:50:29.546421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-062b18e9-85a3-4bc0-a0fa-9196d224c785 req-fe256805-07cb-4034-adae-5c392895544e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f41d629-ef18-4686-bf58-6b13e25fe71d", "tag": "64a76b31-851d-4d9e-a758-2332f4882ab7"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:29.558213 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-062b18e9-85a3-4bc0-a0fa-9196d224c785 req-fe256805-07cb-4034-adae-5c392895544e service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:29.559408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-062b18e9-85a3-4bc0-a0fa-9196d224c785 req-fe256805-07cb-4034-adae-5c392895544e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:29.560438 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-062b18e9-85a3-4bc0-a0fa-9196d224c785 req-fe256805-07cb-4034-adae-5c392895544e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:29.574085 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:29.579216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-062b18e9-85a3-4bc0-a0fa-9196d224c785 req-fe256805-07cb-4034-adae-5c392895544e service nova] Creating event network-changed:64a76b31-851d-4d9e-a758-2332f4882ab7 for instance 0f41d629-ef18-4686-bf58-6b13e25fe71d on hv-cinder-85220 Aug 05 19:50:29.583397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5b6148e7-8f46-4cae-a23c-f7917ea8094a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.613865 Aug 05 19:50:29.585901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 51/100] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:28 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:29.588611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-062b18e9-85a3-4bc0-a0fa-9196d224c785 req-fe256805-07cb-4034-adae-5c392895544e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177941 Aug 05 19:50:29.590493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 50/101] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:29.597200 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:29.597963 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:29.607795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:29.608146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:29.608859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:29.609221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:29.609876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:29.612027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:29.612868 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:29.616043 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:29.616350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:29.616849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:29.617500 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:29.618288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:29.618907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:29.620118 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:29.848791 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:29.862958 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c23f09c5-2412-4ee2-8caf-6d5e8cf4c388 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.261175 Aug 05 19:50:29.870711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 51/102] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:29 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:30.057745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:30.058551 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:30.066073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.066580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.067055 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:30.067977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.068448 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.068898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:30.163104 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:30.175395 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7d872c83-e1e1-40fd-9971-0ca4978f0be6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.588026 Aug 05 19:50:30.175981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 52/103] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:29 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:30.180796 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-2651a154-4f92-4a53-8ce0-21bdd0165e8e req-626a1a86-b606-4cd6-8c6b-c2639d235523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "096fbbf4-4d8a-4e2a-aa55-118994138c19", "tag": "22eda304-25c6-40ca-ba58-e4b19b0a7687"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:30.195785 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-2651a154-4f92-4a53-8ce0-21bdd0165e8e req-626a1a86-b606-4cd6-8c6b-c2639d235523 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.196268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-2651a154-4f92-4a53-8ce0-21bdd0165e8e req-626a1a86-b606-4cd6-8c6b-c2639d235523 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.196693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-2651a154-4f92-4a53-8ce0-21bdd0165e8e req-626a1a86-b606-4cd6-8c6b-c2639d235523 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:30.218517 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-2651a154-4f92-4a53-8ce0-21bdd0165e8e req-626a1a86-b606-4cd6-8c6b-c2639d235523 service nova] Creating event network-changed:22eda304-25c6-40ca-ba58-e4b19b0a7687 for instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 on hv-cinder-85220 Aug 05 19:50:30.219077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-2651a154-4f92-4a53-8ce0-21bdd0165e8e req-626a1a86-b606-4cd6-8c6b-c2639d235523 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 19:50:30.219540 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-2651a154-4f92-4a53-8ce0-21bdd0165e8e req-626a1a86-b606-4cd6-8c6b-c2639d235523 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 19:50:30.220569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.221025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.221452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:30.222160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.222605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.223045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:30.234151 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.compute.rpcapi [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 19:50:30.235091 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] Releasing lock "compute-rpcapi-router" {{(pid=124552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 19:50:30.256263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-96214c68-704f-411b-9d48-f19e55ec8347 None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078885 Aug 05 19:50:30.257173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 53/104] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:30.328385 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:30.337151 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4700739c-c0bc-4f62-b2a7-1d64db80d28c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.286355 Aug 05 19:50:30.338099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 52/105] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:30 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:30.449490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:30.450530 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:30.457332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.458022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.458563 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:30.459673 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.460548 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.461094 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:30.620093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:30.621391 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:30.629623 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.634115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.634959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:30.637998 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:30.638850 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:30.640598 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:31.207758 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:31.219290 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:31.221288 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:31.228221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-376bd247-67ea-49e0-828c-5c5ff02e5a44 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.783348 Aug 05 19:50:31.240074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 54/106] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:30 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:31.242158 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:31.250759 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a43a02a6-71f8-4186-a986-eb1249a48b9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.634821 Aug 05 19:50:31.252883 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:31.253848 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:31.254716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 53/107] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:30 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:31.263993 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:31.264995 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:31.265638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:31.266832 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:31.267246 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:31.267725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:31.267951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:31.268768 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:31.280255 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:31.280678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:31.281107 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:31.281820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:31.295236 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:31.295878 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:31.741309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:31.750599 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b14c0602-0448-477a-ba79-6d2d97566adf tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.509367 Aug 05 19:50:31.763249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 55/108] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:31 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:31.763249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:31.763249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:31.763249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:31.763668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:31.763917 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:31.764821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:31.765273 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:31.766007 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:31.865736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:31.878231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-040caa74-8dcc-4e09-8863-bc69cd7953fc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.621771 Aug 05 19:50:31.879816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 54/109] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:31 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:31.895315 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-6b77e75c-abfa-4277-92d0-ca81524a24ea req-7fadfed3-81ce-4b76-80dd-0d08acab7654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8b5fc0-602e-4268-87ad-27dcff3c7a15", "tag": "82d15027-863b-4373-8830-ede32d2c1d2c"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:31.912984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-6b77e75c-abfa-4277-92d0-ca81524a24ea req-7fadfed3-81ce-4b76-80dd-0d08acab7654 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:31.914036 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-6b77e75c-abfa-4277-92d0-ca81524a24ea req-7fadfed3-81ce-4b76-80dd-0d08acab7654 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:31.915090 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-6b77e75c-abfa-4277-92d0-ca81524a24ea req-7fadfed3-81ce-4b76-80dd-0d08acab7654 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:31.939058 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-6b77e75c-abfa-4277-92d0-ca81524a24ea req-7fadfed3-81ce-4b76-80dd-0d08acab7654 service nova] Creating event network-changed:82d15027-863b-4373-8830-ede32d2c1d2c for instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 on hv-cinder-85220 Aug 05 19:50:31.940247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:31.948773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-6b77e75c-abfa-4277-92d0-ca81524a24ea req-7fadfed3-81ce-4b76-80dd-0d08acab7654 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066988 Aug 05 19:50:31.950182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 55/110] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:31.951346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8afb6de1-8798-4d03-b41b-bc7eb07f90ac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.198969 Aug 05 19:50:31.951925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 56/111] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:31 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:32.255523 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:32.256220 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:32.262882 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.263399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.263836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.264549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.265002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.265427 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.281265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-e6eabed7-245b-4748-80f1-1afd48aecb02 req-75a0fed9-dc87-40c2-b8e8-155e61d20137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aaad333-e443-4c16-8560-ba79a6b1881d", "tag": "bf67316f-5b2f-43b1-9d3a-337a9abda2b3"}, {"name": "network-changed", "server_uuid": "8482cf3d-db2a-41f0-93d3-dece8a8a46f1", "tag": "bdb9fdac-1be5-4013-b134-a99d9d0e368f"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:32.294386 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e6eabed7-245b-4748-80f1-1afd48aecb02 req-75a0fed9-dc87-40c2-b8e8-155e61d20137 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.295074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e6eabed7-245b-4748-80f1-1afd48aecb02 req-75a0fed9-dc87-40c2-b8e8-155e61d20137 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.295523 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e6eabed7-245b-4748-80f1-1afd48aecb02 req-75a0fed9-dc87-40c2-b8e8-155e61d20137 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.311263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-e6eabed7-245b-4748-80f1-1afd48aecb02 req-75a0fed9-dc87-40c2-b8e8-155e61d20137 service nova] Creating event network-changed:bf67316f-5b2f-43b1-9d3a-337a9abda2b3 for instance 6aaad333-e443-4c16-8560-ba79a6b1881d on hv-cinder-85220 Aug 05 19:50:32.311773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-e6eabed7-245b-4748-80f1-1afd48aecb02 req-75a0fed9-dc87-40c2-b8e8-155e61d20137 service nova] Creating event network-changed:bdb9fdac-1be5-4013-b134-a99d9d0e368f for instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 on hv-cinder-85220 Aug 05 19:50:32.319652 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-e6eabed7-245b-4748-80f1-1afd48aecb02 req-75a0fed9-dc87-40c2-b8e8-155e61d20137 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042787 Aug 05 19:50:32.320360 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 57/112] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:32.328727 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:32.330235 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:32.337018 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.337429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.338593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.339549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.340196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.341125 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.419315 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:32.428687 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:32.430198 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:32.432016 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-188cacbb-08d9-498a-8084-4c471740dcb9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.180393 Aug 05 19:50:32.432792 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 56/113] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:32 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:32.515057 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:32.523006 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-62b024b5-4ed4-4fd3-a73a-aa5c3a39845e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.201273 Aug 05 19:50:32.523822 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 58/114] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:32 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:32.773718 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:32.774725 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:32.781388 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.782014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.782705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.783624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.784362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.785204 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.903840 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:32.904710 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:32.910658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.911174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.911782 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.912658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.913120 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.913554 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.923320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:32.930722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8edda4aa-d5fb-4253-8ef8-c22a079ee292 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.160834 Aug 05 19:50:32.931551 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 57/115] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:32 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:32.972917 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:32.973694 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:32.980252 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.980964 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.981580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:32.982462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:32.982944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:32.983543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:33.060778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:33.069105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5379a193-359b-447a-b138-eca573b9cdb6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.170563 Aug 05 19:50:33.070000 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 59/116] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:32 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:33.131827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:33.144677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fe499f2e-dc88-487d-b33e-54802481fd14 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.176329 Aug 05 19:50:33.145505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 58/117] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:32 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:33.455553 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:33.456097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:33.462005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:33.462479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:33.463623 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:33.464313 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:33.464790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:33.465212 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:33.549374 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:33.549981 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:33.555939 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:33.557603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:33.558078 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:33.558816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:33.559269 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:33.559695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:33.605741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:33.613876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:33.615415 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:33.616535 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-242174b9-ea12-4918-b19d-3b5817c93925 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.164936 Aug 05 19:50:33.617100 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 60/118] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:33 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:50:33.698109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:33.706312 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f8f0a0cc-f4ca-43d5-a8c9-996aa3e69003 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.160732 Aug 05 19:50:33.706836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 59/119] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:33 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:33.953638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:33.954237 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:33.960173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:33.960616 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:33.961046 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:33.961720 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:33.962164 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:33.963405 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.092389 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:34.093126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:34.094372 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:34.099410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:34.099972 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:34.100484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.101256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:34.101782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:34.102292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.103459 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2fd94198-44ea-4db4-a52a-018b45e52c44 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.153558 Aug 05 19:50:34.105112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 61/120] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:33 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:34.168726 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:34.169351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:34.175285 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:34.175775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:34.176212 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.176910 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:34.177365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:34.177792 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.235972 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:34.249019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-365afeac-c3b4-41d6-99cf-39c2bb06d5f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.161321 Aug 05 19:50:34.258990 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 60/121] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:34 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:34.329529 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:34.337017 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7e6f941a-07f9-4b6a-87f3-f401076f618e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.172911 Aug 05 19:50:34.337629 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 62/122] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:34 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:34.639309 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:34.639922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:34.646027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:34.646556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:34.647062 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.647774 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:34.648228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:34.648654 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.667982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.727777 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:34.728542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:34.735217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:34.735674 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:34.736874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.736874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:34.737383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:34.737948 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:34.801315 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:34.811098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:34.812818 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:34.814196 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-37bb91d7-aee4-4332-bbca-8cb70a790581 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.178830 Aug 05 19:50:34.814885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 61/123] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:34 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:34.887864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:34.892091 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=100 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.897142 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c020f517-11fc-4e70-893b-0d3398762e1b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.173367 Aug 05 19:50:34.897719 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 63/124] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:34 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:35.125803 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:35.126408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:35.132268 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.132747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.133176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.133858 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.134307 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.136102 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.273600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:35.295348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:35.312143 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.313035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.313841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.314816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.315613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.316562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.458877 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:35.467387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-23b0025a-7977-459e-a5e3-c486d8c88db8 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.345287 Aug 05 19:50:35.468308 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 62/125] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:35 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:35.477591 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:35.486870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:35.493402 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.493975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.494421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.495308 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.498975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.499943 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.852463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:35.859339 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:35.864368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ef45f71b-ed23-4061-b838-9abeb18f354b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.598230 Aug 05 19:50:35.865496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 64/126] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:35 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:35.867789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4e2bf21a-4f5e-4c5d-a952-7d3753e10566 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.398377 Aug 05 19:50:35.868357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 63/127] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:35 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:35.892999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:35.892999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:35.898653 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.899418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.900628 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.903012 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.903719 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.904908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.919103 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:35.919726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:35.934131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.934870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.935770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:35.936521 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:35.937156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:35.937840 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:36.111345 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:36.121036 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:36.122609 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:36.123186 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:36.124588 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-00772f00-52c2-4523-a3a6-78c2aa6c9e9b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.257703 Aug 05 19:50:36.125317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 65/128] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:35 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:36.144501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5fe5f0e1-fc60-47c2-ae42-645e313da40f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.229576 Aug 05 19:50:36.145105 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 64/129] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:35 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:36.488196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:36.488811 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:36.495082 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:36.495946 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:36.496396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:36.497309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:36.497843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:36.498268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:36.704897 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:36.713520 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4da86eb3-b501-4bb5-a073-37d10168e14e tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.229004 Aug 05 19:50:36.718666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 66/130] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:36 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:36.889594 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:36.890260 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:36.895584 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:36.896454 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:36.904261 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:36.904766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:36.904950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:36.905206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:36.905490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:36.905927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:36.906116 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:36.906378 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:36.906848 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:36.907742 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:36.908211 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:36.908637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:37.088989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:37.097122 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-487fee3c-29a2-4738-ba7d-ca7c46ad63d4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.211324 Aug 05 19:50:37.104633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 67/131] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:36 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:37.149312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:37.149954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:37.158965 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:37.160072 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:37.161203 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:37.163135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:37.163693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:37.164193 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:37.164741 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:37.176858 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-450ae9bd-4c50-4372-885d-a001c3f734b5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.293920 Aug 05 19:50:37.177936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 65/132] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:36 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:37.184487 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:37.185342 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:37.192231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:37.192972 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:37.193648 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:37.194553 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:37.195235 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:37.195857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:37.382712 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:37.395261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:37.397934 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:37.398599 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c0352023-d1e3-43b4-aa34-5e5493ca699b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.253748 Aug 05 19:50:37.406373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:37.411275 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 68/133] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:37 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:37.427294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5b6b5279-6aa5-4c83-bf5b-a33ac2a6085c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.247898 Aug 05 19:50:37.430783 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 66/134] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:37 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:37.733509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:37.734355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:37.740594 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:37.741080 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:37.741509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:37.742373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:37.742866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:37.743285 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:37.940239 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:37.949022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-1dd53d71-2369-426c-919f-3be15c7cb53b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.219373 Aug 05 19:50:37.949617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 69/135] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:37 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:38.119445 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:38.120064 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:38.123093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:38.126582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.127086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.127524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.128202 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.128657 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.129079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.203207 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:38.204436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:38.212272 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.213814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.215092 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.216541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.217462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.218838 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.276241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:38.284896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d9a97f0b-972f-496d-957e-6421443b5343 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.169991 Aug 05 19:50:38.285471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 67/136] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:38 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:38.391716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:38.399645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6258abd1-7570-4b56-a240-b5979d3f0ad3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.203560 Aug 05 19:50:38.401240 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 70/137] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:38 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:38.422021 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:38.422650 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:38.430417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.430953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.431932 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.432696 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.433160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.433589 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.451999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:38.452616 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:38.458775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.459562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.459993 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.461029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.461490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.461919 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.600853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:38.610751 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:38.612499 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:38.614854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0c2d1c1d-1cf0-4bb9-901d-65b16bdb3e08 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.196496 Aug 05 19:50:38.615635 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 68/138] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:38 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:38.663602 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:38.672294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-cd96cd9f-a272-49e4-8136-c85d9879929b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.224204 Aug 05 19:50:38.673330 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 71/139] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:38 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:38.970499 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:38.971388 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:38.979574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.980313 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.980926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:38.981797 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:38.982432 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:38.983050 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:39.174508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:39.185239 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-31a469e5-c7ee-4c36-94bd-f19df898e60c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.218717 Aug 05 19:50:39.186186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 69/140] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:38 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:39.334334 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:39.335411 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:39.383350 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:39.389764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:39.392858 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:39.397416 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:39.398121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:39.403892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:39.669626 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-f85cff44-8961-4a4d-a78e-3bfde0e4c8b2 req-c6c68865-4a5e-4165-8489-25d6c14d9e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ae4231-a7c2-485b-82c8-bdc75570832b", "name": "network-vif-plugged", "status": "completed", "tag": "4f490d8a-26d1-4800-889b-5b34f349c42f"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:39.683187 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-f85cff44-8961-4a4d-a78e-3bfde0e4c8b2 req-c6c68865-4a5e-4165-8489-25d6c14d9e5e service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:39.684668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-f85cff44-8961-4a4d-a78e-3bfde0e4c8b2 req-c6c68865-4a5e-4165-8489-25d6c14d9e5e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:39.685410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-f85cff44-8961-4a4d-a78e-3bfde0e4c8b2 req-c6c68865-4a5e-4165-8489-25d6c14d9e5e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:39.702327 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-f85cff44-8961-4a4d-a78e-3bfde0e4c8b2 req-c6c68865-4a5e-4165-8489-25d6c14d9e5e service nova] Creating event network-vif-plugged:4f490d8a-26d1-4800-889b-5b34f349c42f for instance 13ae4231-a7c2-485b-82c8-bdc75570832b on hv-cinder-85220 Aug 05 19:50:39.709423 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-f85cff44-8961-4a4d-a78e-3bfde0e4c8b2 req-c6c68865-4a5e-4165-8489-25d6c14d9e5e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333204 Aug 05 19:50:39.710032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 70/141] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:50:39.733855 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:39.734486 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:39.752635 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:39.755613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:39.756616 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:39.757725 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:39.759060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:39.760134 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:39.976307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:39.991583 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2800ac93-6707-408d-b7e8-4b9c7c693d91 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.688262 Aug 05 19:50:39.992642 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 72/142] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:39 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:40.002190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:40.003118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:40.024712 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:40.033928 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-65694c84-b9e5-4493-b81c-d104a78c5e72 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.322648 Aug 05 19:50:40.034744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 71/143] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:39 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:40.049189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:40.049189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:40.049387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:40.049387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:40.049387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:40.049387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:40.049685 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:40.049685 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:40.050911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:40.051410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:40.052125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:40.052836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:40.053298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:40.054195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:40.230562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:40.257553 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:40.267436 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:40.270383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:40.272549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:40.274037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8ed912d1-69e6-47d3-be5f-27827208b8da tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.278312 Aug 05 19:50:40.281938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ce62bf7e-c410-4120-a817-0c960e54d57a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.245347 Aug 05 19:50:40.284551 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 72/144] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:40 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:40.294682 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 73/145] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:39 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:40.294910 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:40.294910 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:40.300145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:40.300661 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:40.301327 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:40.302036 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:40.302493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:40.302984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:40.470524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:40.487073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-06b98035-4d2d-4529-bbca-0d2c7a10968b tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.196092 Aug 05 19:50:40.487073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 73/146] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:40 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:41.014749 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:41.016280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:41.023189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.023683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.024303 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.025599 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.026654 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.027135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.066942 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:41.069740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:41.092706 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.094109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.095443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.096725 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.097580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.098327 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.323602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:41.335260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ed38b9a2-a5de-4ecb-ab41-0a7de3ca3dfd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.281196 Aug 05 19:50:41.335908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 74/147] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:41 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:41.341919 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:41.342737 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:41.349662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.350272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.350748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.359827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.361239 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.361782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.581825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:41.591728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-77001031-620c-4626-a560-6af38c108e4b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.581708 Aug 05 19:50:41.595788 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 74/148] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:41 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:41.604924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:41.608881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:41.620267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=100 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:41.625242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.626154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.629773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.630947 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.631574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.632367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.943380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:41.955647 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:41.957397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:41.958825 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-621a94e3-772a-4833-9238-3673084d8bf3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.621790 Aug 05 19:50:41.959670 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 75/149] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:41 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:41.965576 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:41.966618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:41.973620 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.974353 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.974920 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:41.975861 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:41.976416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:41.976938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:42.146018 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:42.175879 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d41429e7-5f30-4307-bbc3-531c15589f4f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.575007 Aug 05 19:50:42.180425 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 75/150] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:41 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:42.357462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:42.358094 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:42.364294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:42.365007 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:42.365633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:42.366520 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:42.367187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:42.367854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:42.393961 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:42.409505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ad93e8da-697f-4562-9e06-308add01a5fb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.444003 Aug 05 19:50:42.410376 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 76/151] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:41 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:42.551291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:42.560438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-51c7e09f-bf06-4a10-97fb-72b0ca3f28f5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.207808 Aug 05 19:50:42.561045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 76/152] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:42 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:42.615829 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:42.616372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:42.623545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:42.624036 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:42.624520 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:42.625280 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:42.625742 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:42.626164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:42.845969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:42.860564 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5ded63e4-57aa-41a4-a4f4-3a0fbb38bf24 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.248065 Aug 05 19:50:42.862582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 77/153] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:42 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:42.986397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:42.988439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:43.003778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.006552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.008531 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.011607 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.014733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.017591 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.214236 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:43.214885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:43.223665 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.224168 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.224609 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.225325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.225777 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.226206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.282541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:43.307977 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:43.313177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:43.314346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d9f689e7-927f-4428-b226-7fc3228951bc tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.332913 Aug 05 19:50:43.319229 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 77/154] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:42 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:43.329541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-d5ae00ad-8869-4639-b7c3-6dd52a72f351 req-2933e5ec-b39f-49d5-a0c9-14ecc2ac5c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8482cf3d-db2a-41f0-93d3-dece8a8a46f1", "name": "network-vif-plugged", "status": "completed", "tag": "bdb9fdac-1be5-4013-b134-a99d9d0e368f"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:43.351697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-d5ae00ad-8869-4639-b7c3-6dd52a72f351 req-2933e5ec-b39f-49d5-a0c9-14ecc2ac5c25 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.352598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-d5ae00ad-8869-4639-b7c3-6dd52a72f351 req-2933e5ec-b39f-49d5-a0c9-14ecc2ac5c25 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.353495 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-d5ae00ad-8869-4639-b7c3-6dd52a72f351 req-2933e5ec-b39f-49d5-a0c9-14ecc2ac5c25 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.366956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-d5ae00ad-8869-4639-b7c3-6dd52a72f351 req-2933e5ec-b39f-49d5-a0c9-14ecc2ac5c25 service nova] Creating event network-vif-plugged:bdb9fdac-1be5-4013-b134-a99d9d0e368f for instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 on hv-cinder-85220 Aug 05 19:50:43.373563 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-d5ae00ad-8869-4639-b7c3-6dd52a72f351 req-2933e5ec-b39f-49d5-a0c9-14ecc2ac5c25 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053030 Aug 05 19:50:43.375695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 78/155] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:43.435607 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:43.436012 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:43.468365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.468873 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.470985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.471762 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.472237 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.472672 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.579594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:43.587880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:43.592571 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d50b1db9-2383-4ed3-8923-c1f5d7c68a93 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.382488 Aug 05 19:50:43.593471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 78/156] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:43 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:43.599886 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:43.600807 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:43.610279 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.611117 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.612034 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.612999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.613726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.614383 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.829024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:43.841754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-69c5cb28-7430-494f-a8c6-081f085271d4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.246573 Aug 05 19:50:43.842402 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 79/157] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:43 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:43.885790 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:43.886881 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:43.893424 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.894468 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.895086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.895943 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:43.896545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:43.896781 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:43.897459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:43.909767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-54a351f9-a7d5-4155-a018-328b716bdb23 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1314 microversion: 2.1 time: 0.480181 Aug 05 19:50:43.911237 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 79/158] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:43 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:44.054230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:44.064229 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6aa31d77-e464-4043-83d4-6f3159263d85 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.183068 Aug 05 19:50:44.065253 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 80/159] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:43 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:44.340005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:44.340622 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:44.346581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:44.347369 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:44.347805 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:44.348662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:44.349117 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:44.349555 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:44.486345 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:44.494822 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:44.496894 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:44.498318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-93526cc1-6c46-4034-84ea-f24ef8b42b12 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.162894 Aug 05 19:50:44.498924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 80/160] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:44 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:44.617091 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:44.617725 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:44.630505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:44.636646 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:44.637744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:44.638769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:44.639477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:44.640063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:44.832725 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:44.858761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a7ff37f5-6f66-4b0e-a571-ff44808609bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.242288 Aug 05 19:50:44.862429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 81/161] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:44 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:44.864377 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:44.865072 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:44.880422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:44.881117 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:44.881673 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:44.882659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:44.883071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:44.885523 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:44.888479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=100 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:44.937903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:44.939062 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:44.956637 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:44.957943 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:44.959381 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:44.962112 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:44.969338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:44.969338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:45.055983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:45.065431 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e5fbcf51-8bd0-4271-afc3-bee9db1997e7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.205250 Aug 05 19:50:45.066398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 81/162] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:44 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:45.086512 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:45.088312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:45.097822 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:45.098323 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:45.099305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:45.100041 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:45.100502 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:45.101083 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:45.175857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:45.184765 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5a828683-06af-43da-a5b1-3651d9f16b85 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1501 microversion: 2.1 time: 0.256724 Aug 05 19:50:45.185453 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 82/163] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:44 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:45.265267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:45.275956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2fd7dc58-ccb0-4cb2-a4bc-89237de36313 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.193646 Aug 05 19:50:45.277787 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 82/164] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:45 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:45.404820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-38ee1b14-b3e1-43c6-8e78-5d3c4b377e54 req-1643c427-912d-426f-b3d6-89b0da860958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f41d629-ef18-4686-bf58-6b13e25fe71d", "name": "network-vif-plugged", "status": "completed", "tag": "64a76b31-851d-4d9e-a758-2332f4882ab7"}, {"server_uuid": "6aaad333-e443-4c16-8560-ba79a6b1881d", "name": "network-vif-plugged", "status": "completed", "tag": "bf67316f-5b2f-43b1-9d3a-337a9abda2b3"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:45.422163 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-38ee1b14-b3e1-43c6-8e78-5d3c4b377e54 req-1643c427-912d-426f-b3d6-89b0da860958 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:45.422862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-38ee1b14-b3e1-43c6-8e78-5d3c4b377e54 req-1643c427-912d-426f-b3d6-89b0da860958 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:45.423410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-38ee1b14-b3e1-43c6-8e78-5d3c4b377e54 req-1643c427-912d-426f-b3d6-89b0da860958 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:45.443739 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-38ee1b14-b3e1-43c6-8e78-5d3c4b377e54 req-1643c427-912d-426f-b3d6-89b0da860958 service nova] Creating event network-vif-plugged:64a76b31-851d-4d9e-a758-2332f4882ab7 for instance 0f41d629-ef18-4686-bf58-6b13e25fe71d on hv-cinder-85220 Aug 05 19:50:45.444268 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-38ee1b14-b3e1-43c6-8e78-5d3c4b377e54 req-1643c427-912d-426f-b3d6-89b0da860958 service nova] Creating event network-vif-plugged:bf67316f-5b2f-43b1-9d3a-337a9abda2b3 for instance 6aaad333-e443-4c16-8560-ba79a6b1881d on hv-cinder-85220 Aug 05 19:50:45.452385 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-38ee1b14-b3e1-43c6-8e78-5d3c4b377e54 req-1643c427-912d-426f-b3d6-89b0da860958 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054111 Aug 05 19:50:45.453321 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 83/165] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:45.521987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:45.522800 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:45.533506 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:45.534307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:45.536877 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:45.537885 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:45.538616 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:45.539233 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:45.756262 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:45.765116 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:45.766703 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:45.767821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-af9c40d7-afeb-4880-850d-27e7ba275ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.250042 Aug 05 19:50:45.768387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 83/166] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:45 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:45.882823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:45.883716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:45.890464 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:45.891082 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:45.891594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:45.892366 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:45.892833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:45.893258 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.056678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:46.079666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-32d00b2f-2a8f-4037-ab14-55da4407375d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1364 microversion: 2.1 time: 0.201097 Aug 05 19:50:46.081410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 84/167] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:45 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:46.087816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:46.088718 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:46.096316 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:46.096943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:46.097677 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.098450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:46.099148 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:46.099824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.316582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:46.317298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:46.334285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:46.337949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:46.339994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.340921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:46.341538 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:46.342255 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.490065 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:46.510432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5804056e-6d74-4081-9b93-6a20801af019 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.428104 Aug 05 19:50:46.511322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 84/168] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:46 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:46.537629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:46.547442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9f85864d-caca-4797-b691-ca06261af999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.246623 Aug 05 19:50:46.548357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 85/169] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:46 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:46.659171 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cde2c192-e6fd-4aa8-b7d7-19a3055d37f7"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:46.661769 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:46.669656 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:46.670552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:46.671220 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.672078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:46.672542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:46.672994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.794964 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:46.796183 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:46.805291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:46.807301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:46.808343 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.809932 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:46.810977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:46.811947 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:46.971234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:46.981377 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:46.981377 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:46.982447 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-afcacf60-80a5-46b7-9920-f15ab1c3cc93 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.194062 Aug 05 19:50:46.983095 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 86/170] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:46 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:47.106043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:47.107164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:47.113729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:47.114217 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:47.114731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:47.115429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:47.115878 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:47.116296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:47.269957 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:47.280346 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4339a7f8-d839-49fa-95ba-dce410a43ad9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1550 microversion: 2.1 time: 0.180319 Aug 05 19:50:47.280898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 87/171] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:47 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1550 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:47.301960 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:47.302459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:47.310499 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:47.313808 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:47.314422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:47.315389 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:47.316124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:47.316559 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:47.445266 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0c34a85a-6fe1-442f-9800-a4670caa1318 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147101 Aug 05 19:50:47.445957 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 88/172] 10.222.0.86 () {58 vars in 1275 bytes} [Fri Aug 5 19:50:47 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:50:47.492824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-51e4de6b-a1ce-4cda-81a7-d45c038dd692 req-accae276-ca1a-46fc-b650-f4a1aec92740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8b5fc0-602e-4268-87ad-27dcff3c7a15", "name": "network-vif-plugged", "status": "completed", "tag": "82d15027-863b-4373-8830-ede32d2c1d2c"}, {"server_uuid": "096fbbf4-4d8a-4e2a-aa55-118994138c19", "name": "network-vif-plugged", "status": "completed", "tag": "22eda304-25c6-40ca-ba58-e4b19b0a7687"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:47.527174 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-51e4de6b-a1ce-4cda-81a7-d45c038dd692 req-accae276-ca1a-46fc-b650-f4a1aec92740 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:47.527774 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-51e4de6b-a1ce-4cda-81a7-d45c038dd692 req-accae276-ca1a-46fc-b650-f4a1aec92740 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:47.528676 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-51e4de6b-a1ce-4cda-81a7-d45c038dd692 req-accae276-ca1a-46fc-b650-f4a1aec92740 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:47.544287 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-51e4de6b-a1ce-4cda-81a7-d45c038dd692 req-accae276-ca1a-46fc-b650-f4a1aec92740 service nova] Creating event network-vif-plugged:82d15027-863b-4373-8830-ede32d2c1d2c for instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 on hv-cinder-85220 Aug 05 19:50:47.544801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-51e4de6b-a1ce-4cda-81a7-d45c038dd692 req-accae276-ca1a-46fc-b650-f4a1aec92740 service nova] Creating event network-vif-plugged:22eda304-25c6-40ca-ba58-e4b19b0a7687 for instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 on hv-cinder-85220 Aug 05 19:50:47.552281 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-51e4de6b-a1ce-4cda-81a7-d45c038dd692 req-accae276-ca1a-46fc-b650-f4a1aec92740 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063873 Aug 05 19:50:47.552903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 89/173] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:50:47.560662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:47.561440 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:47.568242 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:47.568741 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:47.569180 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:47.569954 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:47.570411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:47.570858 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:47.944910 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:47.966222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-24dfd593-2624-4ce0-ba29-92249af4eb29 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1366 microversion: 2.1 time: 0.411507 Aug 05 19:50:47.967173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 90/174] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:47 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:47.976891 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:47.983859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:47.997086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:47.997850 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:47.998868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:48.000035 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:48.001150 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:48.002271 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:48.225131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fb04b5a5-0935-4e34-be0b-3cf71360c813 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "POST /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.569634 Aug 05 19:50:48.225961 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 85/175] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:50:46 2022] POST /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b/os-volume_attachments => generated 194 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:48.234447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:48.235878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:48.248863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:48.249670 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:48.250419 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:48.251398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:48.252054 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:48.254208 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:48.470488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:48.488007 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e3607841-e163-44e3-ab9c-00b358632116 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.517814 Aug 05 19:50:48.488645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 91/176] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:47 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:48.496154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:48.523761 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:48.542193 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:48.551794 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-da7be123-ded7-4982-a525-0fa33e4c9b69 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.323965 Aug 05 19:50:48.552424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 86/177] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:48 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:48.996910 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:48.997942 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:49.004731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.005304 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.005837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.006652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.007158 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.007841 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.356267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:49.369371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-baca2ada-8ce6-41d9-81f4-715a0b9b5f2e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1556 microversion: 2.1 time: 0.377276 Aug 05 19:50:49.369897 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 92/178] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:48 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1556 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:49.392154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:49.393856 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:49.402953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.403913 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.404291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.405387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.405845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.406379 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.513577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:49.516180 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:49.519400 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e5c4439f-f6e0-40b4-bf57-7ff74b9a79ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131351 Aug 05 19:50:49.520000 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 87/179] 10.222.0.86 () {58 vars in 1275 bytes} [Fri Aug 5 19:50:49 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:49.530513 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.534995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.535965 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.536926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.537606 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.538252 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.584399 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:49.585490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:49.604692 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.605989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.606908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.607964 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.608813 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.609816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.883261 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:49.897004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-71da7b38-1c83-40e9-92bb-2c2bcc4c3a74 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.389110 Aug 05 19:50:49.898560 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 93/180] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:49 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:49.905690 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-14dc2872-0976-42cf-af2c-a89950124266 req-3bf7bc28-9aee-4b7e-a188-368a44c83a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8482cf3d-db2a-41f0-93d3-dece8a8a46f1", "tag": "bdb9fdac-1be5-4013-b134-a99d9d0e368f"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:49.918439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-14dc2872-0976-42cf-af2c-a89950124266 req-3bf7bc28-9aee-4b7e-a188-368a44c83a84 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:49.919325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-14dc2872-0976-42cf-af2c-a89950124266 req-3bf7bc28-9aee-4b7e-a188-368a44c83a84 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:49.920094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-14dc2872-0976-42cf-af2c-a89950124266 req-3bf7bc28-9aee-4b7e-a188-368a44c83a84 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:49.936826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-14dc2872-0976-42cf-af2c-a89950124266 req-3bf7bc28-9aee-4b7e-a188-368a44c83a84 service nova] Creating event network-changed:bdb9fdac-1be5-4013-b134-a99d9d0e368f for instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 on hv-cinder-85220 Aug 05 19:50:49.943538 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-14dc2872-0976-42cf-af2c-a89950124266 req-3bf7bc28-9aee-4b7e-a188-368a44c83a84 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043074 Aug 05 19:50:49.944689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 94/181] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:50.320598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:50.331039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:50.334198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:50.335608 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f176c7be-e9f9-4cd8-b469-103057fdd1fb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.757929 Aug 05 19:50:50.337096 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 88/182] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:49 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:50:50.922692 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:50.923421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:50.930095 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:50.930733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:50.931372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:50.932312 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:50.932799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:50.933233 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:51.236313 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:51.245193 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-be128463-8d1f-435e-9314-714519dd3a56 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.327870 Aug 05 19:50:51.249978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 95/183] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:50 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:51.360394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:51.361350 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:51.371040 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:51.374747 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:51.375204 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:51.375943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:51.377338 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:51.377775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:51.794099 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:51.812468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:51.814438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:51.816030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-459ebce9-7a40-41dd-9f71-d7ca1119b6ae tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1407 microversion: 2.20 time: 0.460637 Aug 05 19:50:51.817203 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 89/184] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:51 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:52.159024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-10f23f74-82d8-47b9-80eb-e9c988a10121 req-0b5caf0a-346a-42c9-9afb-3c90ff084ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f41d629-ef18-4686-bf58-6b13e25fe71d", "tag": "64a76b31-851d-4d9e-a758-2332f4882ab7"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:52.175359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-10f23f74-82d8-47b9-80eb-e9c988a10121 req-0b5caf0a-346a-42c9-9afb-3c90ff084ea9 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:52.176312 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-10f23f74-82d8-47b9-80eb-e9c988a10121 req-0b5caf0a-346a-42c9-9afb-3c90ff084ea9 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:52.176955 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-10f23f74-82d8-47b9-80eb-e9c988a10121 req-0b5caf0a-346a-42c9-9afb-3c90ff084ea9 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:52.192600 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-10f23f74-82d8-47b9-80eb-e9c988a10121 req-0b5caf0a-346a-42c9-9afb-3c90ff084ea9 service nova] Creating event network-changed:64a76b31-851d-4d9e-a758-2332f4882ab7 for instance 0f41d629-ef18-4686-bf58-6b13e25fe71d on hv-cinder-85220 Aug 05 19:50:52.200079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-10f23f74-82d8-47b9-80eb-e9c988a10121 req-0b5caf0a-346a-42c9-9afb-3c90ff084ea9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046252 Aug 05 19:50:52.201399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 96/185] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:52.280177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:52.288488 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:52.320367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:52.322336 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:52.324112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:52.327506 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:52.329862 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:52.330482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:52.685002 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:52.700265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2b9cd95b-6359-4b97-a207-dfc20bed00bd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1322 microversion: 2.1 time: 0.431902 Aug 05 19:50:52.706711 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 90/186] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:52 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:52.849060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:52.849060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:52.864408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:52.865664 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:52.866179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:52.867189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:52.868822 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:52.869449 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:53.129516 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:53.139269 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:53.141395 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:53.142874 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7f4440c8-ce5d-4d8e-9204-d24218926d91 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1599 microversion: 2.20 time: 0.301827 Aug 05 19:50:53.155961 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 97/187] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:50:52 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1599 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:50:53.167369 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:53.168177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:53.175443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:53.176115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:53.176698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:53.177587 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:53.178182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:53.178783 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:53.376815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fc92820c-a458-4b25-aea9-3e1036c4634d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.214174 Aug 05 19:50:53.378010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 91/188] 10.222.0.86 () {60 vars in 1316 bytes} [Fri Aug 5 19:50:53 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-interface => generated 285 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:50:53.723995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:53.724721 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:53.733984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:53.735911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:53.736485 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:53.737372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:53.737913 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:53.738975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:53.780604 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:53.971877 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:53.985614 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-70e3ef84-6504-48c9-89e0-930615c1d798 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1516 microversion: 2.1 time: 0.263069 Aug 05 19:50:53.986589 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 98/189] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:53 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:54.016471 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:54.018925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:54.031702 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:54.037286 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:54.038026 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:54.038970 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:54.039597 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:54.040960 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:54.081234 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lazy-loading 'flavor' on Instance uuid bc8b5fc0-602e-4268-87ad-27dcff3c7a15 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:50:54.277966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a97ca18a-2290-49b4-817e-5655b9204999 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15/action" status: 200 len: 32 microversion: 2.1 time: 0.265760 Aug 05 19:50:54.279365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 92/190] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:50:54 2022] POST /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 19:50:54.293541 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:54.294975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:54.303167 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:54.303707 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:54.304298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:54.305611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:54.306585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:54.307212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:54.811205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:54.825222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5064b684-b6e2-467b-bac7-6e267a6c8ba1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.535062 Aug 05 19:50:54.827073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 99/191] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:54 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:55.253602 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-e159a5dc-5208-46bc-8b1c-0d0d362331ad req-aa9cafa2-0d71-483e-b8ad-80e423be4fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "096fbbf4-4d8a-4e2a-aa55-118994138c19", "tag": "22eda304-25c6-40ca-ba58-e4b19b0a7687"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:50:55.288707 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e159a5dc-5208-46bc-8b1c-0d0d362331ad req-aa9cafa2-0d71-483e-b8ad-80e423be4fe2 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:55.289329 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e159a5dc-5208-46bc-8b1c-0d0d362331ad req-aa9cafa2-0d71-483e-b8ad-80e423be4fe2 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:55.291118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e159a5dc-5208-46bc-8b1c-0d0d362331ad req-aa9cafa2-0d71-483e-b8ad-80e423be4fe2 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:55.328082 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-e159a5dc-5208-46bc-8b1c-0d0d362331ad req-aa9cafa2-0d71-483e-b8ad-80e423be4fe2 service nova] Creating event network-changed:22eda304-25c6-40ca-ba58-e4b19b0a7687 for instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 on hv-cinder-85220 Aug 05 19:50:55.340178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-e159a5dc-5208-46bc-8b1c-0d0d362331ad req-aa9cafa2-0d71-483e-b8ad-80e423be4fe2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092122 Aug 05 19:50:55.340785 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 93/192] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:50:55.851603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:55.853573 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:55.862369 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:55.863638 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:55.864358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:55.865234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:55.867073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:55.867870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:56.180034 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:56.190094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8bc57e9b-4bd1-40a9-b8c9-83f9d5655e36 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.344873 Aug 05 19:50:56.191713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 100/193] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:55 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:56.218552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:56.220045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:56.231843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:56.234008 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:56.234931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:56.235842 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:56.236464 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:56.237043 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:56.270293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:50:56.314245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:56.405687 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d7a60d24-688c-4d2b-b392-690f20f22cda tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "DELETE /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 204 len: 0 microversion: 2.1 time: 0.192184 Aug 05 19:50:56.406320 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 94/194] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:50:56 2022] DELETE /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:56.415569 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:56.416490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:56.425672 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:56.426179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:56.427104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:56.430095 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:56.431477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:56.432146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:56.754038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:56.763114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ea4fbae5-9556-41ee-af0c-b6cfb8e0e9ef tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1553 microversion: 2.1 time: 0.352054 Aug 05 19:50:56.763703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 101/195] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:56 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1553 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:57.217756 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:57.218580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:57.225089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:57.225581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:57.226086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:57.226948 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:57.229638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:57.229638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:57.402492 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:57.411398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2d1d7ca7-8d17-4de5-b010-a5205d4b0c75 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.198101 Aug 05 19:50:57.426383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 95/196] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:57 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:57.785338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:57.785953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:57.792635 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:57.793123 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:57.793586 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:57.794292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:57.794777 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:57.795207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:57.932462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:57.940778 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5dcf442a-fe0b-4f0b-80ff-2a4956a8649c tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1553 microversion: 2.1 time: 0.159272 Aug 05 19:50:57.941366 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 102/197] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:57 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:58.440954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:58.441586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:58.450101 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:58.450597 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:58.451071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:58.451787 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:58.452249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:58.452679 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:58.588409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:58.595942 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-43433997-8842-48d9-99d4-a81ab496d76c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.158979 Aug 05 19:50:58.597033 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 96/198] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:58 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:58.962946 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:58.963730 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:58.970150 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:58.970718 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:58.971163 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:58.972254 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:58.972346 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:58.972731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:59.122133 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:59.130241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ace550df-82fc-40da-8bb7-be82b6af02eb tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1553 microversion: 2.1 time: 0.171511 Aug 05 19:50:59.130838 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 103/199] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:58 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:59.617578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:50:59.619088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:50:59.625420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:59.625912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:59.626354 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:59.627097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:50:59.627552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:50:59.627978 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:50:59.777861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:50:59.786217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-81b0db59-10c1-4077-b742-22706cd12760 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.172590 Aug 05 19:50:59.786833 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 97/200] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:50:59 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:00.151303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:00.151914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:00.157991 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:00.158475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:00.158944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:00.159647 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:00.160101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:00.160527 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:00.295948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:00.304054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-80d947f0-0dde-4992-98d5-6fe669f4ad75 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1553 microversion: 2.1 time: 0.157189 Aug 05 19:51:00.304619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 104/201] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:00 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:00.808954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:00.809564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:00.816580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:00.817071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:00.817512 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:00.818214 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:00.818696 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:00.819132 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:00.981835 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:00.991048 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f3b87596-e2e5-408f-949e-54eecec04a66 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.186868 Aug 05 19:51:00.991704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 98/202] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:00 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:01.326362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:01.326963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:01.333104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:01.333697 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:01.334139 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:01.334870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:01.335501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:01.335928 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:01.503632 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:01.512740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0999ad3b-f015-4118-9ede-d0fda01df343 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1553 microversion: 2.1 time: 0.191184 Aug 05 19:51:01.513316 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 105/203] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:01 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:02.014079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:02.014717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:02.021241 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:02.021763 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:02.022203 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:02.022948 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:02.023405 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:02.023978 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:02.174779 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:02.184141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f79275e8-abc1-484a-869a-dac3f62fbd38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.173879 Aug 05 19:51:02.184830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 99/204] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:02 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:02.535169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:02.535787 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:02.543070 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:02.543567 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:02.544005 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:02.544715 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:02.545173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:02.545602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:02.688393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:02.697117 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-04fc2282-a012-4bab-b598-176ac4090e18 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1553 microversion: 2.1 time: 0.165349 Aug 05 19:51:02.697924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 106/205] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:02 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:03.205460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:03.206076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:03.214068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:03.214560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:03.215038 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:03.215740 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:03.216196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:03.216627 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:03.367692 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:03.376501 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e100c63e-1941-4eaa-9747-8a56035e589c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.174919 Aug 05 19:51:03.377101 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 100/206] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:03 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:03.423749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-ba4f32e5-c2d9-45e3-a3d6-29d6af757e39 req-e9e344c8-3297-4cb2-bc2c-b13b286f3b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ae4231-a7c2-485b-82c8-bdc75570832b", "name": "network-vif-deleted", "tag": "4f490d8a-26d1-4800-889b-5b34f349c42f"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:51:03.437093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ba4f32e5-c2d9-45e3-a3d6-29d6af757e39 req-e9e344c8-3297-4cb2-bc2c-b13b286f3b4c service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:03.437885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ba4f32e5-c2d9-45e3-a3d6-29d6af757e39 req-e9e344c8-3297-4cb2-bc2c-b13b286f3b4c service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:03.438322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ba4f32e5-c2d9-45e3-a3d6-29d6af757e39 req-e9e344c8-3297-4cb2-bc2c-b13b286f3b4c service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:03.452578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-ba4f32e5-c2d9-45e3-a3d6-29d6af757e39 req-e9e344c8-3297-4cb2-bc2c-b13b286f3b4c service nova] Creating event network-vif-deleted:4f490d8a-26d1-4800-889b-5b34f349c42f for instance 13ae4231-a7c2-485b-82c8-bdc75570832b on hv-cinder-85220 Aug 05 19:51:03.458318 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-ba4f32e5-c2d9-45e3-a3d6-29d6af757e39 req-e9e344c8-3297-4cb2-bc2c-b13b286f3b4c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038285 Aug 05 19:51:03.459073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 107/207] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:51:03.719856 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:03.720468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:03.726494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:03.727022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:03.727462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:03.728771 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:03.729224 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:03.729661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:03.797106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:03.805493 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d7c9e059-66ff-48d1-bde8-220299e224fc tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1511 microversion: 2.1 time: 0.089487 Aug 05 19:51:03.806326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 101/208] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:03 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:04.400131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:04.400849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:04.407141 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:04.407627 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:04.408063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:04.408762 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:04.409216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:04.409641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:04.557384 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:04.565300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-cd4b9d68-1aee-4cba-b3ac-cbcd16dd1837 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.171323 Aug 05 19:51:04.565874 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 108/209] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:04 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:04.827398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:04.828000 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:04.834440 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:04.834954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:04.835393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:04.836084 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:04.836539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:04.836969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:04.900693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:04.909093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-32259e01-22b7-42ee-b7a7-3df72b5682b9 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1345 microversion: 2.1 time: 0.085510 Aug 05 19:51:04.909672 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 102/210] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:04 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:05.586978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:05.587846 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:05.593895 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:05.594378 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:05.594849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:05.595547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:05.596001 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:05.596416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:05.753597 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:05.763339 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9ed658b7-4719-456d-8596-133abe17fe0a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.180101 Aug 05 19:51:05.763922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 109/211] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:05 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:05.930659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:05.931574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:05.938373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:05.938902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:05.939333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:05.940023 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:05.940476 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:05.940898 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:05.974530 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:05.975035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:05.975466 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:05.975906 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lazy-loading 'fault' on Instance uuid 13ae4231-a7c2-485b-82c8-bdc75570832b {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:51:06.021627 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d7a67f595b44a89abe80bc4f714821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773fbf1acca4df9947f053573486931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:06.030522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b3fd6fb1-07fb-44ac-a198-8eb9f4293fde tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 200 len: 1350 microversion: 2.1 time: 0.103757 Aug 05 19:51:06.031365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 103/212] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:05 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:06.786322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:06.787043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:06.798992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:06.799485 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:06.799922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:06.800731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:06.801162 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:06.801583 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:06.942012 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:06.955799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-38c03e67-d51d-4c12-9d9d-804e1cf0262e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.167626 Aug 05 19:51:06.955799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 110/213] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:06 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:07.053754 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:07.054389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:07.062711 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:07.063210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:07.063653 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:07.064422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:07.064887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:07.065322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:07.080246 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] HTTP exception thrown: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Request method failure captured: Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b HTTP/1.1 Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRfmRZe5k1TGsDsrA33_8Xl8CYceeAiBcwgbeIC4tLdCDzgrBHOVnfXOAIKhPlfimRUHOKjeZ1UmGu9aJ-x3s2rMQFFVhIlwcan8fdxapZg-BQ-cV5dIKvUj1ChxxneztH4EcRQW7-9AU6IWVLP1S0xwis-AVhds7ryiUlhagChAxA Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: d773fbf1acca4df9947f053573486931 Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:51:07.085062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d773fbf1acca4df9947f053573486931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d773fbf1acca4df9947f053573486931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d773fbf1acca4df9947f053573486931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d773fbf1acca4df9947f053573486931"}]}] Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: d773fbf1acca4df9947f053573486931 Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-DeleteServersTestJSON-938759086-project Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a1d7a67f595b44a89abe80bc4f714821 Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-DeleteServersTestJSON-938759086-project Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.086578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '13ae4231-a7c2-485b-82c8-bdc75570832b'} Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:51:07.087450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.088844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.089819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Returning 404 to user: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:51:07.089819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-726c4e30-cd96-428c-84e7-65a1147b974f tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 404 len: 111 microversion: 2.1 time: 0.037132 Aug 05 19:51:07.089819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 104/214] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:07 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:51:07.210767 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:07.212994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:07.221971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:07.222466 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:07.222946 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:07.223671 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:07.224161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:07.224636 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:07.241593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] HTTP exception thrown: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Request method failure captured: Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b/os-volume_attachments HTTP/1.1 Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRfmRZe5k1TGsDsrA33_8Xl8CYceeAiBcwgbeIC4tLdCDzgrBHOVnfXOAIKhPlfimRUHOKjeZ1UmGu9aJ-x3s2rMQFFVhIlwcan8fdxapZg-BQ-cV5dIKvUj1ChxxneztH4EcRQW7-9AU6IWVLP1S0xwis-AVhds7ryiUlhagChAxA Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: d773fbf1acca4df9947f053573486931 Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:51:07.246608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d773fbf1acca4df9947f053573486931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d773fbf1acca4df9947f053573486931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d773fbf1acca4df9947f053573486931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d773fbf1acca4df9947f053573486931"}]}] Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: d773fbf1acca4df9947f053573486931 Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-DeleteServersTestJSON-938759086-project Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: a1d7a67f595b44a89abe80bc4f714821 Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-DeleteServersTestJSON-938759086-project Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.248188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'server_id': '13ae4231-a7c2-485b-82c8-bdc75570832b'} Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:51:07.248821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:07.249835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:07.251825 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Returning 404 to user: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:51:07.251825 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7748ead7-48dc-4fa3-83f3-d146b49a0fa6 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041476 Aug 05 19:51:07.253182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 111/215] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:51:07 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:51:07.971822 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:07.972647 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:07.980502 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:07.981002 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:07.981447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:07.982160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:07.984701 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:07.984701 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:08.142614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:08.152163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fcddb8b7-e34d-4286-9d3a-b4a0dfd6ba13 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.184513 Aug 05 19:51:08.152738 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 105/216] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:07 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:08.514765 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:08.515530 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:08.523536 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=89 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:08.524389 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:08.530853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:08.531644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:08.532406 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:08.532868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:08.533288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:08.552539 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] HTTP exception thrown: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Request method failure captured: Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b HTTP/1.1 Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRfmRZe5k1TGsDsrA33_8Xl8CYceeAiBcwgbeIC4tLdCDzgrBHOVnfXOAIKhPlfimRUHOKjeZ1UmGu9aJ-x3s2rMQFFVhIlwcan8fdxapZg-BQ-cV5dIKvUj1ChxxneztH4EcRQW7-9AU6IWVLP1S0xwis-AVhds7ryiUlhagChAxA Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: d773fbf1acca4df9947f053573486931 Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:51:08.554753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d773fbf1acca4df9947f053573486931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d773fbf1acca4df9947f053573486931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d773fbf1acca4df9947f053573486931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d773fbf1acca4df9947f053573486931"}]}] Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: d773fbf1acca4df9947f053573486931 Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-DeleteServersTestJSON-938759086-project Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: a1d7a67f595b44a89abe80bc4f714821 Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-DeleteServersTestJSON-938759086-project Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.556729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '13ae4231-a7c2-485b-82c8-bdc75570832b'} Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:51:08.557505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.558686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.559993 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Returning 404 to user: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:51:08.559993 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-45b081b4-6cfe-4326-92c3-e563fcebc0de tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "DELETE /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 404 len: 111 microversion: 2.1 time: 0.046994 Aug 05 19:51:08.559993 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 112/217] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:51:08 2022] DELETE /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:51:08.566305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:08.566305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] [instance: 13ae4231-a7c2-485b-82c8-bdc75570832b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:08.573213 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:08.573562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:08.574037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:08.574743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:08.575202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:08.575630 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:08.600541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] HTTP exception thrown: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Request method failure captured: Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b HTTP/1.1 Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRfmRZe5k1TGsDsrA33_8Xl8CYceeAiBcwgbeIC4tLdCDzgrBHOVnfXOAIKhPlfimRUHOKjeZ1UmGu9aJ-x3s2rMQFFVhIlwcan8fdxapZg-BQ-cV5dIKvUj1ChxxneztH4EcRQW7-9AU6IWVLP1S0xwis-AVhds7ryiUlhagChAxA Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: d773fbf1acca4df9947f053573486931 Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:51:08.603823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d773fbf1acca4df9947f053573486931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/d773fbf1acca4df9947f053573486931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_d773fbf1acca4df9947f053573486931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/d773fbf1acca4df9947f053573486931"}]}] Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: d773fbf1acca4df9947f053573486931 Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-DeleteServersTestJSON-938759086 Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-DeleteServersTestJSON-938759086-project Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a1d7a67f595b44a89abe80bc4f714821 Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-DeleteServersTestJSON-938759086-project Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.606067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '13ae4231-a7c2-485b-82c8-bdc75570832b'} Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:51:08.607201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. Aug 05 19:51:08.608878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:51:08.610218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] Returning 404 to user: Instance 13ae4231-a7c2-485b-82c8-bdc75570832b could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:51:08.610218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3422407b-0b14-441e-9412-d80a0aeea732 tempest-DeleteServersTestJSON-938759086 tempest-DeleteServersTestJSON-938759086-project] 10.222.0.86 "GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b" status: 404 len: 111 microversion: 2.1 time: 0.044744 Aug 05 19:51:08.613359 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 106/218] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:08 2022] GET /compute/v2.1/servers/13ae4231-a7c2-485b-82c8-bdc75570832b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:51:09.174942 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:09.175571 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:09.185003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:09.185653 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:09.186511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:09.187408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:09.187867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:09.188289 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:09.347642 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:09.356313 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dc099777-5225-4de9-97b6-2e6a18959d7c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.185118 Aug 05 19:51:09.356895 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 113/219] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:09 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:10.380139 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:10.381197 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:10.389559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:10.390052 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:10.390480 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:10.391213 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:10.391670 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:10.392263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:10.567925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:10.579920 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a2044f20-5bdc-48f2-9ccd-178bb63f9f8b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.205934 Aug 05 19:51:10.580496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 107/220] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:10 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:11.601038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:11.601757 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:11.609444 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:11.609938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:11.610402 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:11.611099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:11.611555 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:11.611969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:11.776038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:11.787065 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fd0b452e-0828-4542-b452-69585646df39 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.189770 Aug 05 19:51:11.787631 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 114/221] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:11 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:12.809522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:12.810271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:12.812929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:12.818887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:12.819430 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:12.819960 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:12.820730 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:12.821956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:12.822664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:12.987079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:12.995529 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6d907d53-85a0-4ddc-9c74-1aee26bbad47 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.191150 Aug 05 19:51:12.996283 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 108/222] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:12 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:14.017670 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:14.018451 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:14.024461 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:14.025384 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:14.026076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:14.026815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:14.027269 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:14.027710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:14.172482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:14.180129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b03fc2ce-7f2f-4a81-b59f-623f0e4441df tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.166750 Aug 05 19:51:14.181028 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 115/223] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:14 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:15.202075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:15.202975 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:15.209614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:15.210101 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:15.210532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:15.211355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:15.213167 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:15.213643 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:15.392424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:15.402669 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-af24e81b-68e3-4d8a-9e44-9ebb0fb0ed86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.204104 Aug 05 19:51:15.403254 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 109/224] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:15 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:16.424869 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:16.425565 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:16.433641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:16.434165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:16.434610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:16.435605 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:16.436406 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:16.437069 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:16.584433 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:16.596143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7576a1fc-38ec-48c7-9cf9-7c1782845407 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.175141 Aug 05 19:51:16.596919 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 116/225] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:16 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:17.619344 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:17.621629 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:17.628274 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:17.628815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:17.629255 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:17.629969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:17.630431 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:17.630900 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:17.797899 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:17.810326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8257f3c4-857a-429e-9903-f4c2902e6ca5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.195732 Aug 05 19:51:17.814687 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 110/226] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:17 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:18.831475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:18.832150 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:18.839306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:18.839853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:18.840217 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:18.841195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:18.841651 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:18.842271 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:18.846985 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:19.051647 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:19.068817 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-52e97db0-3b58-412c-a061-100f2579d7c0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.240794 Aug 05 19:51:19.076706 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 117/227] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:18 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:20.094653 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:20.095979 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:20.103689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:20.104225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:20.104671 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:20.105384 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:20.105843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:20.106271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:20.249748 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:20.253380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.258493 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b3dd0553-a4eb-48a9-a2d2-760e564ebd7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.167794 Aug 05 19:51:20.259424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 111/228] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:20 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:21.280859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:21.281515 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:21.287667 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:21.288153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:21.288587 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:21.289298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:21.290431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:21.291005 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:21.428442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:21.437764 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-00123a52-6659-4b11-88f4-a414a8fa23f5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.160816 Aug 05 19:51:21.442261 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 118/229] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:21 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:22.460073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:22.460715 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:22.469771 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:22.470510 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:22.470987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:22.471689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:22.472136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:22.472562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:22.615683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:22.623882 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-36171ae3-f517-4a44-98ad-b30eaceaa92e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.167959 Aug 05 19:51:22.624463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 112/230] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:22 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:23.646294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:23.647585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:23.655598 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:23.656098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:23.656815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:23.657601 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:23.658132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:23.658653 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:23.833022 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:23.844200 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b6556999-8f10-4690-a999-dec320137fcd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.202530 Aug 05 19:51:23.844915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 119/231] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:23 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:24.865385 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:24.866001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:24.873053 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:24.873582 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:24.874030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:24.874779 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:24.875244 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:24.875678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:25.024444 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:25.033958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-42380998-d1ed-42e5-9b8e-83bb4e8b7d45 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.172324 Aug 05 19:51:25.034548 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 113/232] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:24 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:26.057459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:26.058081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:26.064421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:26.064903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:26.065335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:26.066033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:26.066484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:26.066940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:26.199288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:26.206862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-29f346bd-d632-465b-8648-0017053680d7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.154276 Aug 05 19:51:26.207441 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 120/233] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:26 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:27.227926 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:27.228541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:27.235226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:27.235710 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:27.236147 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:27.236844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:27.237403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:27.237977 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:27.374977 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:27.382590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-512ff327-ca33-47bf-b516-d38d56bc3f4d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.158602 Aug 05 19:51:27.383198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 114/234] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:27 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:28.404775 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:28.405392 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:28.411487 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:28.411977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:28.412416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:28.413119 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:28.413575 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:28.414020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:28.818801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:28.828419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-35434598-133c-4feb-a097-f7974b031cf9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.427613 Aug 05 19:51:28.831340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 121/235] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:28 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:29.861713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:29.863940 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:29.873394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:29.875089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:29.875787 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:29.876586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:29.877366 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:29.878195 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:30.044481 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:30.054248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ce7772c9-4c82-46ac-816b-aacf69342746 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.196911 Aug 05 19:51:30.057225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 115/236] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:29 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:31.079567 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:31.080417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:31.086806 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:31.087392 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:31.087911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:31.088750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:31.089416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:31.090096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:31.253145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:31.261543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-42cda7f0-6f37-4104-a256-c1f3f704cb8c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.185823 Aug 05 19:51:31.262121 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 122/237] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:31 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:32.284178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:32.284882 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:32.292201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:32.292694 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:32.293137 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:32.293936 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:32.294397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:32.294884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:32.430432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:32.438773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-de65dc51-9458-40d7-92c8-91083aa2a1bb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.158437 Aug 05 19:51:32.439355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 116/238] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:32 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:33.459926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:33.460660 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:33.467372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:33.467852 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:33.468293 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:33.469010 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:33.469558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:33.469990 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:33.621557 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:33.629973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f4a33105-e93a-4698-9cd8-35543c95a037 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.173803 Aug 05 19:51:33.637508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 123/239] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:33 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:34.653281 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:34.654541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:34.662371 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:34.662914 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:34.663355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:34.664062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:34.664749 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:34.665339 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:34.803360 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:34.815204 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d170775f-9afd-4428-8be5-d3cf24ca2cb0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.166685 Aug 05 19:51:34.815789 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 117/240] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:34 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:35.836792 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:35.837424 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:35.843690 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:35.844231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:35.844617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:35.845319 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:35.845779 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:35.846206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:35.987144 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:35.995602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ae98756c-f089-45b0-bdd7-0a2a320a7849 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.163121 Aug 05 19:51:35.996180 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 124/241] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:35 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:37.018808 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:37.019410 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:37.026852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:37.027379 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:37.027842 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:37.028497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:37.028952 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:37.029380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:37.183541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:37.191792 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f91f18a6-a699-4283-b6e4-80b769ff2a1b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.177439 Aug 05 19:51:37.192656 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 118/242] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:37 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:38.214770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:38.215399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:38.221546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:38.222035 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:38.222467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:38.223207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:38.223659 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:38.224081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:38.381548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:38.390298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-62dc79d3-d550-49c7-aae0-ab8588d4fe3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.180305 Aug 05 19:51:38.391031 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 125/243] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:38 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:39.412771 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:39.414830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:39.422442 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:39.422966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:39.423409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:39.424948 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:39.425435 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:39.425908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:39.577762 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:39.588526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9a4900d4-d72e-4199-a116-5f65e4752329 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.179472 Aug 05 19:51:39.589221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 119/244] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:39 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:40.610106 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:40.610723 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:40.612606 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=28 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:40.618254 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:40.618779 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:40.619256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:40.619971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:40.620426 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:40.620853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:40.772523 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:40.781358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-99571a7c-6a53-4f6c-a0f9-450dbd05540c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.175050 Aug 05 19:51:40.781944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 126/245] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:40 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:41.803708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:41.804766 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:41.813482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:41.813986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:41.814429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:41.815340 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:41.815810 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:41.816240 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:42.098810 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:42.108177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9f7834e1-fa61-47ef-a353-4b39305f021b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.309310 Aug 05 19:51:42.109017 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 120/246] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:41 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:43.132175 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:43.132794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:43.140236 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:43.140728 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:43.141248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:43.142034 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:43.142519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:43.142980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:43.285375 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:43.293429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-311315c8-b10c-4882-bbe7-db1b34f86bb2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.165656 Aug 05 19:51:43.293984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 127/247] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:43 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:44.316211 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:44.316813 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:44.319333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=26 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.328344 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:44.328854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:44.329349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:44.330117 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:44.330684 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:44.331119 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:44.471727 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:44.481035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ded8ec26-06e5-4768-9d86-d3fbca78ca25 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.168213 Aug 05 19:51:44.481957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 121/248] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:44 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:45.504659 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:45.505892 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:45.513603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:45.514093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:45.514528 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:45.515276 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:45.515731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:45.516156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:45.657194 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:45.664704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ebfca932-53bb-4a4d-b9e0-ae96e171fa82 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.164000 Aug 05 19:51:45.665272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 128/249] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:45 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:46.686210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:46.686852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:46.693369 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:46.693855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:46.694288 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:46.695014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:46.695460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:46.695889 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:46.838608 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:46.847504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d151f403-077d-45ac-b3a1-f6918cfcea3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.165842 Aug 05 19:51:46.848182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 122/250] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:46 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:47.872396 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:47.873058 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:47.879977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:47.880694 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:47.881438 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:47.882647 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:47.883203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:47.883640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:48.065936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:48.079844 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5a429e41-95ec-40ef-8c45-4e4995d430b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.214153 Aug 05 19:51:48.080360 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 129/251] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:47 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:49.108439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:49.108439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:49.111924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:49.113301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:49.113599 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:49.114964 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:49.115671 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:49.116190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:49.269680 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:49.278909 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-48649e98-b029-46b7-93b7-6a7d2ba6dfac tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.180340 Aug 05 19:51:49.279493 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 123/252] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:49 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:50.305725 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:50.306452 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:50.312709 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:50.313191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:50.313617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:50.314309 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:50.314785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:50.315205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:50.317931 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=77 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:50.455876 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:50.466986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2923d6f8-aa69-4359-ab30-fcfc36adc72c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.165420 Aug 05 19:51:50.467578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 130/253] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:50 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:51.491205 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:51.492178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:51.502884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:51.502884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:51.502884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:51.503211 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:51.506280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:51.506280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:51.647575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:51.656598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-00696936-73a4-4019-8f35-df597efafb5e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.170943 Aug 05 19:51:51.657175 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 124/254] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:51 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:52.679488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:52.680113 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:52.687244 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:52.688009 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:52.688448 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:52.689159 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:52.689617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:52.690047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:52.847676 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:52.855804 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c787e5ad-dc08-4bfb-aca8-a8770f8c0c0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.180134 Aug 05 19:51:52.856377 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 131/255] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:52 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:53.877305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:53.877916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:53.884726 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:53.885399 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:53.886028 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:53.887040 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:53.887521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:53.887943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:53.894377 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=79 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.050988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:54.059106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9e7f5d09-f201-4e7e-8559-d296e558e983 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1522 microversion: 2.1 time: 0.185614 Aug 05 19:51:54.059694 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 125/256] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:53 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:55.080860 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:55.081569 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:55.088440 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:55.088897 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:55.089337 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:55.090045 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:55.090504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:55.090959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:55.261131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:55.272338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-92aede27-ec20-432d-85c3-07256a8460aa tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1502 microversion: 2.1 time: 0.195279 Aug 05 19:51:55.272935 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 132/257] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:55 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:55.294355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:55.294998 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:55.301560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:55.302045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:55.302488 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:55.303662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:55.303868 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:55.304226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:55.474989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:55.483847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ddba3b62-3e87-490d-8e76-6538f8744531 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1516 microversion: 2.1 time: 0.194467 Aug 05 19:51:55.485463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 126/258] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:55 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:56.910189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:51:56.912606 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:56.919902 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:56.925132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:56.925132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:56.925132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:56.925132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:56.925479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:56.950159 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lazy-loading 'flavor' on Instance uuid 6aaad333-e443-4c16-8560-ba79a6b1881d {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:51:57.075053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-da3ec15a-ec85-4726-a250-f33f02525364 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d/action" status: 200 len: 32 microversion: 2.1 time: 0.168201 Aug 05 19:51:57.075980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 133/259] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:51:56 2022] POST /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:51:57.086161 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:57.086824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:57.093602 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:57.094138 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:57.094690 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:57.095435 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:57.095976 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:57.096421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:57.245832 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:57.253886 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-94e64cda-2918-4e9b-9431-af4518f57d15 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.171691 Aug 05 19:51:57.254465 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 127/260] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:57 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:58.279307 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:58.280051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:58.287542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:58.288076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:58.288481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:58.289200 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:58.289657 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:58.290122 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:58.438398 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:58.446056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-035798e0-b82e-4d72-a941-9994bb82047e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.173138 Aug 05 19:51:58.446980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 134/261] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:58 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:59.468297 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:51:59.468905 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:51:59.476005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:59.476460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:59.476858 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:59.478336 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:51:59.478707 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:51:59.479103 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:51:59.628734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:51:59.637619 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d807be06-f2e8-48a2-ac4f-2f08839bd29f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.173076 Aug 05 19:51:59.638141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 128/262] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:51:59 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:00.664318 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:00.665010 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:00.671129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:00.671623 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:00.672038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:00.672728 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:00.673176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:00.673594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:00.815529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:00.826393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f5dbcf27-e02e-46b8-b543-960e87543e2f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.167263 Aug 05 19:52:00.826935 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 135/263] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:00 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:01.852850 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:01.853742 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:01.860295 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:01.860773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:01.861234 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:01.861925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:01.862376 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:01.862835 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:02.004760 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:02.014649 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7729164d-6357-4761-85ae-b2525f41f048 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.165789 Aug 05 19:52:02.015234 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 129/264] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:01 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:03.035939 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:03.036656 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:03.044577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:03.045059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:03.045493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:03.046182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:03.046660 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:03.047075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:03.185565 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:03.193025 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f162b3b1-3904-4c85-9548-51cfa372eaf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.160994 Aug 05 19:52:03.193602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 136/265] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:03 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:04.215942 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:04.216786 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:04.230102 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:04.230695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:04.231169 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:04.231913 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:04.232376 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:04.232816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:04.373655 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:04.381352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f43074a5-de4d-4917-a4a3-204b98db545c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.170596 Aug 05 19:52:04.381922 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 130/266] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:04 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:05.402219 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:05.403000 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:05.409401 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:05.409878 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:05.410303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:05.411039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:05.411482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:05.411896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:05.561954 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:05.574107 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3c968585-96db-4ab4-b4ab-ffb817884453 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.175734 Aug 05 19:52:05.575099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 137/267] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:05 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:06.597477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:06.598123 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:06.605934 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:06.606426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:06.606909 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:06.607617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:06.608076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:06.608507 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:06.746181 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:06.753826 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e8b791e8-923e-4bd2-8954-926bd9fa5e4e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.160249 Aug 05 19:52:06.754402 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 131/268] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:06 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:07.775534 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:07.776146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:07.782105 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:07.782584 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:07.783049 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:07.783743 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:07.784201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:07.784621 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:08.063688 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:08.071977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-db9a7648-21e7-43ed-be7c-796bae691cfc tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.301108 Aug 05 19:52:08.072563 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 138/269] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:07 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:09.093550 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:09.094089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:09.100575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:09.101058 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:09.101524 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:09.102227 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:09.103014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:09.103612 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:09.239381 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:09.247907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e6cf7c2a-072f-413e-96c1-a847eeb4e438 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.158349 Aug 05 19:52:09.248491 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 132/270] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:09 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:10.275129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:10.275129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:10.279061 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:10.279551 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:10.279978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:10.280683 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:10.281127 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:10.281545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:10.440237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:10.448902 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3a282da4-1d5e-4608-8c09-ba02e96b17b4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.183757 Aug 05 19:52:10.449468 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 139/271] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:10 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:11.474201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:11.474869 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:11.482600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:11.483125 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:11.483921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:11.484643 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:11.485105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:11.485537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:11.626111 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:11.636164 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7b6fc9a5-abb9-48ff-88b3-d2f73c616307 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.165682 Aug 05 19:52:11.636676 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 133/272] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:11 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:12.052684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:12.053520 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:12.056163 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=28 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:12.061387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:12.061889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:12.062325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:12.063073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:12.063529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:12.063951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:12.090249 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a23bc05f-2068-45e6-be83-b402e0416da2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/ips" status: 200 len: 146 microversion: 2.1 time: 0.041518 Aug 05 19:52:12.091081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 140/273] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:52:12 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:12.378795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:12.379343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:12.386399 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:12.387023 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:12.387741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:12.388581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:12.390173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:12.390358 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:12.418969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6d8ab287-d64a-4843-aafd-16b08aff6af5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/ips" status: 200 len: 149 microversion: 2.1 time: 0.044766 Aug 05 19:52:12.419556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 134/274] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:52:12 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:12.657583 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:12.658202 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:12.665009 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:12.665874 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:12.666389 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:12.667271 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:12.667740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:12.668171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:12.895315 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:12.905868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4d19ca97-d880-47ac-95b5-50be2ac8dffe tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.252265 Aug 05 19:52:12.905868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 141/275] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:12 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:13.212473 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:13.213008 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:13.220253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:13.220744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:13.221185 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:13.221884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:13.222401 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:13.222944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:13.248580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8c53b836-f7ec-4a29-a8fe-f0abcae74a26 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/ips" status: 200 len: 152 microversion: 2.20 time: 0.041378 Aug 05 19:52:13.249159 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 135/276] 10.222.0.86 () {60 vars in 1289 bytes} [Fri Aug 5 19:52:13 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:13.926565 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:13.927861 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:13.936108 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:13.936600 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:13.937039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:13.937744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:13.938229 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:13.938677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:14.083669 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:14.092932 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a287c54b-e8ee-406e-bbd2-fb84436ed744 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.170260 Aug 05 19:52:14.093516 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 142/277] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:13 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:14.239355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dd24e06-9dfd-4aac-8ff9-aaec7c8f9845"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:14.245750 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:14.254476 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:14.255249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:14.255870 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:14.256767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:14.257380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:14.258051 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:14.648431 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ab86996a-d51f-432f-9f65-39a3b8156b6d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414059 Aug 05 19:52:14.650181 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 136/278] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:52:14 2022] POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:52:15.050402 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90ab3fa6-9619-4d7b-acf6-a635b31113af"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:15.052763 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:15.061349 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:15.061901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:15.062502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:15.063069 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:15.063520 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:15.063941 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:15.119288 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:15.120010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:15.122426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=32 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.127772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:15.128274 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:15.128831 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:15.129470 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:15.129927 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:15.130352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:15.287970 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:15.293326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9531a4dd-3930-44f4-ac04-1905ce5039e0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.182123 Aug 05 19:52:15.294031 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 137/279] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:15 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:15.560253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:15.560253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:15.560253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:15.560498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:15.561174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:15.561474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:15.561933 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:15.562504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:15.592888 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lazy-loading 'flavor' on Instance uuid 096fbbf4-4d8a-4e2a-aa55-118994138c19 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:52:15.668462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.683319 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4bef7f1d-061b-4042-92fd-367b48697ba9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.636113 Aug 05 19:52:15.684133 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 143/280] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:52:15 2022] POST /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:15.808284 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-976d276a-6d19-4df6-acd3-7648c0dbef2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/action" status: 202 len: 0 microversion: 2.20 time: 0.260286 Aug 05 19:52:15.808864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 138/281] 10.222.0.86 () {62 vars in 1319 bytes} [Fri Aug 5 19:52:15 2022] POST /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:52:15.817666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:15.818397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:15.826087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:15.826585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:15.827032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:15.827731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:15.828179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:15.828596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:15.972599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:15.983234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:15.984271 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:15.985461 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f29839b3-7f75-418a-bff0-6dac4fc85232 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.171989 Aug 05 19:52:15.986798 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 144/282] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:15 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:16.316905 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:16.317607 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:16.325995 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:16.326483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:16.326949 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:16.327652 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:16.328107 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:16.328533 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:16.331429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:16.473793 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:16.484163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-12113485-f4e0-4e7e-82cb-77e22d5612e6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.171993 Aug 05 19:52:16.484743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 139/283] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:16 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:17.010077 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:17.010751 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:17.017534 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:17.018015 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:17.018450 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:17.019175 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:17.019650 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:17.020073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:17.165435 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:17.175683 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:17.177216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:17.178568 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ff245f1a-43b7-4ecc-a735-ec4fafcac6fa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.172439 Aug 05 19:52:17.179416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 145/284] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:17 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:17.506744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:17.507286 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:17.514940 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:17.515428 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:17.515868 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:17.516618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:17.517161 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:17.517856 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:17.653217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:17.660873 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0eda38da-80e1-427d-8e71-a198340603f6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.158123 Aug 05 19:52:17.661454 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 140/285] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:17 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:18.202084 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:18.203413 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:18.214423 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:18.215002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:18.215444 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:18.216171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:18.216703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:18.217143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:18.365023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:18.373720 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:18.375259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:18.376418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6767fb69-3717-46e4-8e85-b322e8950339 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.178316 Aug 05 19:52:18.376975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 146/286] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:18 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:18.683748 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:18.685819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:18.691749 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:18.692273 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:18.692705 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:18.693483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:18.693999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:18.694432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:18.837819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:18.845493 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-334283ce-a512-4e07-bdf2-70192339c4b8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.167091 Aug 05 19:52:18.846074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 141/287] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:18 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:19.400999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:19.401723 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:19.408580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:19.409074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:19.409513 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:19.410221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:19.410696 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:19.411126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:19.560985 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:19.575575 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:19.577988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:19.579837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-edd00d0b-b4d5-41d6-972c-0f8d7a8c59f6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.183783 Aug 05 19:52:19.580739 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 147/288] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:19 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:19.868367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:19.869186 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:19.875502 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:19.876001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:19.876473 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:19.877184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:19.877647 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:19.878113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:20.038133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:20.051698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-586ccd7a-d739-4c67-bc1a-3db3b37688f7 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.187886 Aug 05 19:52:20.052724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 142/289] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:19 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:20.604655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:20.605266 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:20.611868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:20.612355 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:20.612795 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:20.613498 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:20.613951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:20.614409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:20.763245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:20.771700 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:20.773292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:20.775170 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0552aae1-f94e-4553-8850-f2756b7c4fef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.175726 Aug 05 19:52:20.775735 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 148/290] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:20 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:21.075658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:21.076459 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:21.082967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:21.083454 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:21.083898 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:21.084600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:21.085055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:21.085483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:21.225432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:21.233367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-cee86772-af9f-461d-b34b-86c78cc64513 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.162312 Aug 05 19:52:21.233950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 143/291] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:21 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:21.799067 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:21.799658 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:21.808548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:21.810195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:21.811393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:21.816363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:21.816363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:21.816363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:21.978845 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:21.989578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:21.992118 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:21.994901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-52dc8752-e098-4ff3-ae63-d1b28419c880 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.199818 Aug 05 19:52:21.995471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 149/292] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:21 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:22.257432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:22.258875 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:22.272169 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:22.272664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:22.273107 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:22.274053 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:22.274722 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:22.275368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:22.426164 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:22.436049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-27af5424-61c4-4b7c-bff6-01acf2dcfd0e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.185410 Aug 05 19:52:22.436649 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 144/293] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:22 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:23.023455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:23.025718 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:23.035893 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:23.037276 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:23.038011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:23.039763 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:23.040826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:23.041604 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:23.248875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:23.260823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:23.264967 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:23.265175 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-263b2046-d95b-4a3e-ac78-c69126ad4892 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.247537 Aug 05 19:52:23.281225 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 150/294] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:23 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:52:23.460707 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:23.462163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:23.470823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:23.471721 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:23.472296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:23.473147 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:23.473809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:23.474499 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:23.675230 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:23.687394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a71f4ed2-e95c-436e-b256-923fca9cddc5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.230271 Aug 05 19:52:23.690345 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 145/295] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:23 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:24.293782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:24.295400 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:24.304351 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:24.309571 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:24.310387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:24.312530 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:24.313338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:24.314417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:24.552973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:24.571406 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:24.572995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:24.574219 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c9c267e1-0b1c-4c82-9608-79870f154bc9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.289850 Aug 05 19:52:24.574814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 151/296] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:24 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:24.715579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:24.716673 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:24.734465 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:24.735768 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:24.736848 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:24.738474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:24.739551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:24.740654 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:24.922179 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:24.930353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-53d24eca-8f15-4ae7-a845-9653818aba3f tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.222064 Aug 05 19:52:24.931642 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 146/297] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:24 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:25.613984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:25.615746 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:25.627853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:25.629274 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:25.629949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:25.631260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:25.631734 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:25.632172 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:25.827420 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:25.837566 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:25.838914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:25.840128 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-691a7762-5a06-4277-a32c-fb356f55d371 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.232185 Aug 05 19:52:25.840731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 152/298] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:25 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:25.954041 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:25.954772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:25.966392 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:25.969841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:25.970487 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:25.972567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:25.973428 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:25.974105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:26.165495 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:26.177721 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c86f1a5b-f771-4c30-b062-37b52512f21b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.228685 Aug 05 19:52:26.179038 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 147/299] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:25 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:26.865951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:26.866658 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:26.876828 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:26.877329 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:26.877762 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:26.882086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:26.884397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:26.885301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:26.887657 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-333a6035-9dd4-4d9c-9ffe-bfe24cc80ad2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:26.915345 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-333a6035-9dd4-4d9c-9ffe-bfe24cc80ad2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:26.915966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-333a6035-9dd4-4d9c-9ffe-bfe24cc80ad2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:26.916418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-333a6035-9dd4-4d9c-9ffe-bfe24cc80ad2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.035599 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-333a6035-9dd4-4d9c-9ffe-bfe24cc80ad2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Going to try to stop instance {{(pid=124552) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 19:52:27.094868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:27.113198 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:27.116003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:27.130426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-333a6035-9dd4-4d9c-9ffe-bfe24cc80ad2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/action" status: 202 len: 0 microversion: 2.1 time: 0.247368 Aug 05 19:52:27.131001 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-096e41ca-1d1b-4f08-9a88-ae7ea39ba29c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.268066 Aug 05 19:52:27.140291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 148/300] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:52:26 2022] POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:52:27.143296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 153/301] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:26 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:27.153867 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-237474033", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "networks": [{"uuid": "80ecba96-3387-44f7-a5ab-1098b6a2ba73"}]}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:27.156487 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:27.157302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:27.166063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.166859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.167474 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.168352 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.168965 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.169721 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.245043 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] validate_networks() for [('80ecba96-3387-44f7-a5ab-1098b6a2ba73', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:52:27.400075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:27.411074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-637c0df1-8d03-4dcd-84fc-65fa6da4b8ce tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.266584 Aug 05 19:52:27.411770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 154/302] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:27 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:27.417823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:27.418709 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:27.426215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.426215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.426215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.426675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.427033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.427836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.602458 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:27.610582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c0cfbe8c-aa14-4813-a14e-3d757011e0ea tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1502 microversion: 2.1 time: 0.197416 Aug 05 19:52:27.611370 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 155/303] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:27 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:27.632826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3ed6aa8-4246-48b4-80be-6b7ed5105726"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:27.636014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:27.642156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.642679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.643109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.643814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.644267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.644691 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.671305 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] HTTP exception thrown: Cannot 'attach_volume' instance 6aaad333-e443-4c16-8560-ba79a6b1881d while it is in vm_state rescued Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Request method failure captured: Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: POST /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d/os-volume_attachments HTTP/1.1 Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 74 Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRoBp7v2JhjAzgVq1cWsYiA0mH9TZlZoUjqM4s3bbCY4VzEGYMq8T6pPBvK77eXO7ywOgkhRmCAZgAIFq7kt4N1tU6o_U5KnIjXcbPNn0aeYnrrGb5UNkx50nMwoJoHd4BAsufzPPDT2agJBFtcA6nesUSm5FI09tcwFD4V2eRvHLA Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:52:27.673046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}] Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: d183fcdae86448caa81c09823dd3884e Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {"volumeAttachment": {"volumeId": "a3ed6aa8-4246-48b4-80be-6b7ed5105726"}} Aug 05 19:52:27.674492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Cannot 'attach_volume' instance 6aaad333-e443-4c16-8560-ba79a6b1881d while it is in vm_state rescued Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'server_id': '6aaad333-e443-4c16-8560-ba79a6b1881d', 'body': {'volumeAttachment': {'volumeId': 'a3ed6aa8-4246-48b4-80be-6b7ed5105726'}}} Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6aaad333-e443-4c16-8560-ba79a6b1881d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:52:27.675397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6aaad333-e443-4c16-8560-ba79a6b1881d while it is in vm_state rescued Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:52:27.676629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:52:27.677640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:52:27.677640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:52:27.677640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6aaad333-e443-4c16-8560-ba79a6b1881d while it is in vm_state rescued Aug 05 19:52:27.677640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:52:27.677640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Returning 409 to user: Cannot 'attach_volume' instance 6aaad333-e443-4c16-8560-ba79a6b1881d while it is in vm_state rescued {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:52:27.677640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f926723e-bc0d-4561-a409-ccd0a8ae3119 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045747 Aug 05 19:52:27.677640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 156/304] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:52:27 2022] POST /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 05 19:52:27.684477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:27.685005 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:27.691050 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.691539 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.691973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.692671 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.693124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.693544 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.746045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:52:27.746472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:52:27.746992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:52:27.747408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:52:27.747821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:52:27.759266 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.760053 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.760526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.761285 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.761698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.762145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.781132 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Getting quotas for project 018e12e98f1143d6acaf348cfea45763. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:52:27.783877 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6ea7f49e-d4b8-48cb-87bf-c230208a3536 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d/action" status: 202 len: 0 microversion: 2.1 time: 0.103128 Aug 05 19:52:27.784962 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 157/305] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:52:27 2022] POST /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:52:27.786545 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Getting quotas for user acfba24ac674454d86e415b38c0c4618 and project 018e12e98f1143d6acaf348cfea45763. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:52:27.794864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:27.795574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:27.800039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:52:27.804357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.804357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.806870 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:52:27.807059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.807059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:27.807059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:27.807059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:27.856622 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-77456c6c-165b-43fe-ab50-7aa0de72dcf0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713765 Aug 05 19:52:27.857269 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 149/306] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:52:27.871593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-da185f9e-8260-46b8-9775-05b5646b5a57 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:27.872732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-da185f9e-8260-46b8-9775-05b5646b5a57 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:27.941675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-da185f9e-8260-46b8-9775-05b5646b5a57 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:27.950207 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-da185f9e-8260-46b8-9775-05b5646b5a57 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1218 microversion: 2.1 time: 0.085521 Aug 05 19:52:27.951174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 150/307] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:27 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:28.075668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:28.085716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-63384517-f4c1-4377-9be0-f0be13678ffb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1510 microversion: 2.1 time: 0.295233 Aug 05 19:52:28.086745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 158/308] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:27 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1510 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:28.156899 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:28.157633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:28.167694 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:28.168517 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:28.169271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:28.170152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:28.170878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:28.171456 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:28.411424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:28.421373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:28.422924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:28.424089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-64b804f5-9bf1-4efb-a885-b592e9632b1a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.271877 Aug 05 19:52:28.424655 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 151/309] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:28 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:28.434113 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:28.434962 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:28.442213 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:28.443359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:28.443504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:28.444170 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:28.444621 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:28.445047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:28.698536 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:28.700961 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:28.709066 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d43abee9-e205-4b8b-9efc-45de8cea7715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.279232 Aug 05 19:52:28.710064 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 159/310] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:28 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:28.973620 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:28.974378 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:28.981906 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:28.982436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:28.982929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:28.983619 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:28.984251 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:28.984689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:29.062469 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:29.072929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5cb77088-c570-4b0d-a79d-efb326815505 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1270 microversion: 2.1 time: 0.104091 Aug 05 19:52:29.073841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 152/311] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:28 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:29.108555 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:29.109198 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:29.119911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:29.120504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:29.121019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:29.122017 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:29.122492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:29.122969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:29.326924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:29.334833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-596fc3b5-c31a-4d41-86b7-d0baced76551 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1510 microversion: 2.1 time: 0.230074 Aug 05 19:52:29.335412 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 160/312] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:29 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:29.449451 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:29.450098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:29.456792 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:29.457368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:29.457876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:29.458580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:29.459072 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:29.459542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:29.597547 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:29.606248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:29.607805 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:29.608979 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-441d4050-8c51-4418-80f4-665a05ad4793 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.164150 Aug 05 19:52:29.609538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 153/313] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:29 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:29.732572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:29.733184 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:29.739166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:29.739649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:29.740090 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:29.740793 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:29.741245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:29.741689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:29.887615 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:29.897630 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9c506197-6642-4fa7-a741-e72dc09002e3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.168686 Aug 05 19:52:29.898421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 161/314] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:29 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:30.095826 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:30.096463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:30.102804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:30.103339 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:30.103778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:30.104477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:30.104937 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:30.105386 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:30.171479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:30.181729 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8fdbc697-6065-45ca-889f-8b56d34bb5d6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1270 microversion: 2.1 time: 0.089674 Aug 05 19:52:30.182343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 154/315] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:30 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:30.358740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:30.359442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:30.365989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:30.366463 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:30.366950 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:30.367748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:30.368476 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:30.368986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:30.537414 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:30.548688 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-833f6a9b-d996-40ac-b31d-bd5a0f653e76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1510 microversion: 2.1 time: 0.194260 Aug 05 19:52:30.549284 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 162/316] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:30 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:30.632680 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:30.634160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:30.641855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:30.642550 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:30.643260 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:30.644145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:30.644743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:30.645310 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:30.801851 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:30.811651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:30.813586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:30.815030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-14a8a9b7-4e50-4828-9138-205370b16718 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.186410 Aug 05 19:52:30.815613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 155/317] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:30 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:30.920166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:30.920673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:30.927052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:30.927872 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:30.928351 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:30.929536 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:30.930952 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:30.931399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:31.150343 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:31.158656 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2a885ee9-2d00-4d15-94e3-50a180bf0fb7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.242656 Aug 05 19:52:31.159279 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 163/318] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:30 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:31.203983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:31.204490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:31.210806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:31.211605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:31.211741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:31.212628 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:31.213179 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:31.213615 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:31.229342 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:31.280314 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:31.288114 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c23543e0-4981-4127-be5f-332b70d045e7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1276 microversion: 2.1 time: 0.088097 Aug 05 19:52:31.288690 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 156/319] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:31 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:31.574664 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:31.575587 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:31.583344 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:31.583835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:31.584274 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:31.584983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:31.585437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:31.585862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:31.842126 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:31.842754 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:31.849380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:31.849874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:31.850360 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:31.851087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:31.852043 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:31.853432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:32.008135 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:32.018380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1c7450b6-651e-4b74-93f3-a36bdbfeda18 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1510 microversion: 2.1 time: 0.450011 Aug 05 19:52:32.019709 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 164/320] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:31 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:32.020338 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:32.031056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:32.034810 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:32.039112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a4f66105-ce2d-4d29-9eef-766ac62c9ca9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.200861 Aug 05 19:52:32.043912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 157/321] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:31 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:32.182105 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:32.182771 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:32.188641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:32.189127 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:32.189559 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:32.190258 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:32.190733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:32.191153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:32.310567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:32.311765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:32.324549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:32.325196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:32.326172 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:32.327841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:32.328047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:32.328658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:32.418178 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:32.421498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:32.426475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2509a9c2-b44e-42d9-be96-9f56c98a76f2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.249734 Aug 05 19:52:32.427072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 165/322] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:32 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:32.429705 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-eb24937c-ee57-42bb-bf20-4af9ddf84078 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1276 microversion: 2.1 time: 0.123503 Aug 05 19:52:32.431055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 158/323] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:32 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:33.041744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:33.042651 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:33.050766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:33.051820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:33.052073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:33.052938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:33.053507 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:33.054034 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:33.065539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:33.066160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:33.073995 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:33.074518 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:33.074981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:33.075691 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:33.076318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:33.076910 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:33.253886 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:33.265811 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:33.267516 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:33.268811 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-cfd26323-cea0-4b8b-a249-b12a79964daa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.207294 Aug 05 19:52:33.269537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 159/324] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:33 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:52:33.313880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:33.324439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2f77d65c-846c-4d8d-b680-3f6f7269742a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1516 microversion: 2.1 time: 0.288003 Aug 05 19:52:33.325008 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 166/325] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:33 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:33.453252 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:33.455937 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:33.458434 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:33.460974 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:33.469573 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:33.471049 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:33.471496 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:33.472890 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:33.473460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:33.474369 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:33.481811 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:33.485417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:33.486061 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:33.489540 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:33.493045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:33.494082 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:33.686717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:33.729626 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5411ae0e-3b57-4ff6-a7c4-839397c15dc3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.284630 Aug 05 19:52:33.730837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 160/326] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:33 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:33.807338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:33.822458 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-23236a18-e4be-41c3-b9da-5945ea1cf1eb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.373413 Aug 05 19:52:33.824435 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 167/327] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:33 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:33.987203 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-0854d530-1ee9-430d-ae91-3f21a25ad090 req-6ee3cefd-ecbf-4570-8106-d6179cdd8d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3c8e06-58d8-4b20-b8fc-0eb1093446a5", "tag": "1be14536-3e2f-4338-b020-de2e2e6fc820"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:34.004596 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0854d530-1ee9-430d-ae91-3f21a25ad090 req-6ee3cefd-ecbf-4570-8106-d6179cdd8d7a service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:34.005091 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0854d530-1ee9-430d-ae91-3f21a25ad090 req-6ee3cefd-ecbf-4570-8106-d6179cdd8d7a service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:34.006539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0854d530-1ee9-430d-ae91-3f21a25ad090 req-6ee3cefd-ecbf-4570-8106-d6179cdd8d7a service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:34.020047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-0854d530-1ee9-430d-ae91-3f21a25ad090 req-6ee3cefd-ecbf-4570-8106-d6179cdd8d7a service nova] Creating event network-changed:1be14536-3e2f-4338-b020-de2e2e6fc820 for instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 on hv-cinder-85220 Aug 05 19:52:34.028020 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-0854d530-1ee9-430d-ae91-3f21a25ad090 req-6ee3cefd-ecbf-4570-8106-d6179cdd8d7a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045650 Aug 05 19:52:34.029033 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 161/328] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:34.297913 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:34.298546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:34.314447 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:34.315321 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:34.318408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:34.319275 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:34.319831 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:34.320581 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:34.404130 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-28de1af5-f7c8-4dd4-9f20-3719ecfdcc83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: .version_select at 0x7f18c84f3430>, body: {"keypair": {"name": "tempest-keypair-1683447362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTbF1oWum2Dsj2yc/a/srtdfvSR3Ai+8RbtyXU3QEfyOGAuos/v9IyQU9sGY6EIiy5DPmOtTyrkxV/KliWVyvUp+cMX6XhFoQDpG/X2YCIFMfDC2jyQrHIAZ7E9zOJwew=="}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:34.442270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-28de1af5-f7c8-4dd4-9f20-3719ecfdcc83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:52:34.450860 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-28de1af5-f7c8-4dd4-9f20-3719ecfdcc83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for user a357a3d27e4e41adae1c56ee39ae5aa7 and project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:52:34.534017 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-28de1af5-f7c8-4dd4-9f20-3719ecfdcc83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137381 Aug 05 19:52:34.534658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 162/329] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:52:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:34.624954 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:34.654187 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:34.655901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:34.658547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8ff35df3-f881-4a15-bb4b-2dcf9975d650 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.367579 Aug 05 19:52:34.672168 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 168/330] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:34 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:34.752187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:34.752990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:34.762177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:34.763011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:34.763688 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:34.764981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:34.765403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:34.766007 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:34.846152 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:34.847248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:34.856312 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:34.857075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:34.857612 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:34.858785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:34.859487 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:34.860324 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:34.933772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:34.945937 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c4f5baf8-ca96-4fee-8eaf-26ebdf32cee2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.197143 Aug 05 19:52:34.948074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 163/331] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:34 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:34.956580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dfc9c28d-889e-4e26-8175-07eabb0fdc7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'create', calling method: .version_select at 0x7f18c8290940>, body: {"keypair": {"name": "tempest-keypair-2029107281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzCRLxwZ1g3vA/WO2BFwTcXPDaf4O5u4e4MqwHcVRI4ZYPu01PilDyme7/deLvH6+4CDsn6io7DFWhDo076hIHpn2QJtqmyCfpOZnR/tSH5WSBjIJgmBLJmTizZ6c5kgA=="}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:34.980380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-dfc9c28d-889e-4e26-8175-07eabb0fdc7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Getting quotas for project afed1554d1394cfc8abea0e6c5e15b3f. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:52:34.985372 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-dfc9c28d-889e-4e26-8175-07eabb0fdc7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Getting quotas for user d183fcdae86448caa81c09823dd3884e and project afed1554d1394cfc8abea0e6c5e15b3f. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:52:35.014102 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dfc9c28d-889e-4e26-8175-07eabb0fdc7d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064647 Aug 05 19:52:35.015202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 164/332] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:52:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:35.073581 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:35.081078 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-51abd1cf-8e0d-4780-9b3b-5152ff2568f7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.239964 Aug 05 19:52:35.082216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 169/333] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:34 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:35.687610 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:35.688704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:35.696373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:35.697984 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:35.698692 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:35.699432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:35.699901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:35.700339 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:35.970607 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:35.971436 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:35.971614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:35.984417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:35.985525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:35.986049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:35.986691 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:35.987769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:35.987885 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:35.988591 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:35.989002 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7e900f56-5a84-4392-a2a2-782fe0c01e10 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.306767 Aug 05 19:52:35.998723 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 165/334] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:35 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:36.005468 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:36.108122 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:36.108789 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:36.121208 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:36.121973 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:36.122436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:36.123191 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:36.123654 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:36.124084 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:36.344014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:36.356617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-84c2a8fc-8c86-495a-8b61-f1ec4358e90d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.390329 Aug 05 19:52:36.360333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:36.362775 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 170/335] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:35 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:36.378247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-838b366e-f09f-41bc-93c1-16e9ed681f6c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.275195 Aug 05 19:52:36.378903 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 166/336] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:36 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:36.720867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-646618569", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "959e8ab5-efdc-46d3-bf82-ceecf78a7830"}], "security_groups": [{"name": "tempest-securitygroup--716611879"}], "key_name": "tempest-keypair-1683447362", "user_data": "}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:36.902379 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] validate_networks() for [('959e8ab5-efdc-46d3-bf82-ceecf78a7830', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:52:37.012259 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:37.013893 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:37.020871 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:37.021484 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:37.022389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:37.023127 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:37.023609 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:37.024349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:37.183225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:37.192955 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:37.194541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:37.196661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-22084dc6-3914-40f3-9c92-543c48abde7f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.188555 Aug 05 19:52:37.206115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 167/337] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:37 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:37.382994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:37.384198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:37.395648 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:37.396735 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:37.397556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:37.399051 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:37.399821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:37.401590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:37.593364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:37.606109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d43f5529-990f-4815-85aa-711dcf6b7437 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.229508 Aug 05 19:52:37.620932 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 168/338] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:37 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:37.621033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:52:37.621033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:52:37.621033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:52:37.621033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:52:37.621033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:52:37.626661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:37.626862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:37.627284 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:37.627399 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:37.628004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:37.628450 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:37.628944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:37.629562 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:37.629714 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.639767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:37.640526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:37.640755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:37.643935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:37.643935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:37.643935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:37.655285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:52:37.660052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for user a357a3d27e4e41adae1c56ee39ae5aa7 and project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:52:37.672730 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:52:37.675169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:52:37.737297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e48d79db-34fe-4e34-8ef4-ea1f9dc4e67b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.020631 Aug 05 19:52:37.745060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 171/339] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:52:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:52:37.750962 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1090273759", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa15076f-c074-4bfb-abe0-9aae0ed18fed"}], "security_groups": [{"name": "tempest-securitygroup--1223681083"}], "key_name": "tempest-keypair-2029107281", "user_data": "}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:37.770147 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.816798 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:37.824999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3923cd7b-70d6-48d3-9a00-135917318971 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.212763 Aug 05 19:52:37.825590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 169/340] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:37 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:37.830816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0b9aa163-7501-4a03-86ed-189a0ca72ebb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:37.831439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0b9aa163-7501-4a03-86ed-189a0ca72ebb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:37.923622 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] validate_networks() for [('aa15076f-c074-4bfb-abe0-9aae0ed18fed', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:52:37.946065 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0b9aa163-7501-4a03-86ed-189a0ca72ebb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:37.955396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0b9aa163-7501-4a03-86ed-189a0ca72ebb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1241 microversion: 2.1 time: 0.128291 Aug 05 19:52:37.956688 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 170/341] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:37 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:38.222837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:38.223745 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:38.233379 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.234608 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.235304 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.236590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.237347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.237988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.394924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:52:38.395484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:52:38.396042 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:52:38.396630 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:52:38.398443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:52:38.410136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.410729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.411248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.412060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.412736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.413364 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.425845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:38.436032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:38.437917 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:38.438633 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Getting quotas for project afed1554d1394cfc8abea0e6c5e15b3f. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:52:38.439530 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-bf906eed-a339-48ab-a3d1-4b3ec7bcef71 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.223366 Aug 05 19:52:38.440089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 171/342] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:38 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:52:38.443963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Getting quotas for user d183fcdae86448caa81c09823dd3884e and project afed1554d1394cfc8abea0e6c5e15b3f. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:52:38.460303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:52:38.463680 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:52:38.521734 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fa85b69c-ebd2-4e9e-b691-2d9d31815c38 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.775251 Aug 05 19:52:38.522511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 172/343] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:52:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:52:38.533617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-74c4e1e0-6648-4b66-9e4e-e4e7a2303cbb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:38.534170 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-74c4e1e0-6648-4b66-9e4e-e4e7a2303cbb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:38.606198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-74c4e1e0-6648-4b66-9e4e-e4e7a2303cbb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:38.612967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-74c4e1e0-6648-4b66-9e4e-e4e7a2303cbb tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1246 microversion: 2.1 time: 0.083359 Aug 05 19:52:38.613666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 172/344] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:38 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:38.628016 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:38.628640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:38.636576 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.637178 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.637698 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.638419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.638914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.639369 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.803057 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:38.812618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2db940e6-3bfb-4300-8fdb-dcc9e017989a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.188423 Aug 05 19:52:38.813205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 173/345] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:38 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:38.848324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:38.848932 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:38.856168 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.856801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.857257 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.858095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.858714 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.859157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.979749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:38.980357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:38.990934 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:38.995314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.995951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.996512 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:38.997779 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:38.998356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:38.999672 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:39.108907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:39.119569 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-58121106-4cc8-4fae-b4c9-9997abe89063 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1237 microversion: 2.1 time: 0.146515 Aug 05 19:52:39.121738 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:39.123543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 174/346] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:38 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1237 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:39.152510 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b10ae7e9-ae25-4ff5-8443-83b9676d5019 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.307851 Aug 05 19:52:39.153575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 173/347] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:38 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:39.464177 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:39.464825 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:39.471825 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:39.472325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:39.472769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:39.473482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:39.473944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:39.474394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:39.651163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:39.666966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:39.692186 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:39.694001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:39.696845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:39.698098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:39.698865 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:39.701207 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:39.718355 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:39.746750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:39.748721 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:39.750104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-41ed77b6-5aa9-4233-882b-f2b788a40ffa tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1745 microversion: 2.20 time: 0.290442 Aug 05 19:52:39.769348 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 175/348] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:39 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1745 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:39.833372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:39.833998 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:39.844979 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:39.846018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:39.846737 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:39.847870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:39.848821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:39.849667 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:39.877748 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:39.887690 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-81da024e-b716-4a70-a927-5fe5d510630d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1242 microversion: 2.1 time: 0.255187 Aug 05 19:52:39.901463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 174/349] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:39 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1242 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:40.155073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:40.155837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:40.167999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:40.168593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:40.169043 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:40.169959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:40.170474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:40.171004 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:40.338519 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:40.363778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ea7dcc9c-5fc2-46fa-a315-9213a887563b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1311 microversion: 2.1 time: 0.216697 Aug 05 19:52:40.366536 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 175/350] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:40 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:40.378549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:40.385394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:40.392293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:40.393013 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:40.393626 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:40.394493 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:40.395364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:40.395971 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:40.479115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:40.491816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-70ef6cf6-e1af-4ecc-ba30-83583adee7b7 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.662282 Aug 05 19:52:40.493722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 176/351] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:39 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:40.787929 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:40.788543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:40.801114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:40.801622 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:40.803197 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:40.805896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:40.806949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:40.807549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:41.024373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:41.032006 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ec32a2ad-efdd-44cb-ba6b-1b7aada5c5ab tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.663754 Aug 05 19:52:41.032664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 176/352] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:40 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:41.037451 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:41.038308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:41.045370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:41.046115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:41.046761 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:41.047645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:41.048269 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:41.048863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:41.153662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:41.156231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:41.164309 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:41.166174 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:41.167587 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-189b9aa2-87ee-493a-b394-5e9bacd8c31e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1745 microversion: 2.20 time: 0.384161 Aug 05 19:52:41.179114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 177/353] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:40 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1745 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:41.201689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:41.204650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=100 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:41.214568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5119e8cf-70e6-479b-a599-35e849ef862d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1304 microversion: 2.1 time: 0.180620 Aug 05 19:52:41.217651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 177/354] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:41 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:41.389056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:41.389842 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:41.406335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:41.408352 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:41.410383 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:41.411173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:41.411644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:41.412077 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:41.516856 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:41.517908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:41.527389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:41.528304 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:41.528967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:41.529916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:41.530605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:41.531451 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:41.561327 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:41.575104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-275937df-b577-4bc9-8d08-df81fd953161 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1299 microversion: 2.1 time: 0.189797 Aug 05 19:52:41.576338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 178/355] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:41 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:42.011476 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:42.026167 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-67e8befa-0e49-43ad-9dab-90ae3d7a8bb6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.513052 Aug 05 19:52:42.040668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 178/356] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:41 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:42.056557 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:42.057212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:42.072114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.072904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.073524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.074287 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.075108 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.075541 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.193567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:42.194262 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:42.204907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.205412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.205861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.212949 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.213531 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.213994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.379475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:42.397554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-08041987-7583-4dfb-90e5-c712ac122290 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.347707 Aug 05 19:52:42.410905 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 179/357] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:42 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:42.417207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:42.425713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:42.440501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.441009 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.441452 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.442168 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.442646 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.443080 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.672739 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:42.691018 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:42.694917 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:42.700063 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e32b85a7-437a-4c9e-9fb3-36fb0e5069d0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1745 microversion: 2.20 time: 0.510794 Aug 05 19:52:42.704233 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 179/358] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:42 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1745 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:42.714320 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:42.716246 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:42.743496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.744077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.745663 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.747803 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.748325 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.750509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.895132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:42.912177 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ed31e6ee-4425-466d-a95c-49cb18e060f1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.499577 Aug 05 19:52:42.912771 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 180/359] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:42 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:42.943525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-ebc0ea60-f71b-451e-ad1d-1c620ba6d163 req-6ecea881-d1fe-40a5-9ffd-e3d9826f39a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3c8e06-58d8-4b20-b8fc-0eb1093446a5", "name": "network-vif-plugged", "status": "completed", "tag": "1be14536-3e2f-4338-b020-de2e2e6fc820"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:42.959605 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ebc0ea60-f71b-451e-ad1d-1c620ba6d163 req-6ecea881-d1fe-40a5-9ffd-e3d9826f39a4 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:42.960481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ebc0ea60-f71b-451e-ad1d-1c620ba6d163 req-6ecea881-d1fe-40a5-9ffd-e3d9826f39a4 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:42.961903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ebc0ea60-f71b-451e-ad1d-1c620ba6d163 req-6ecea881-d1fe-40a5-9ffd-e3d9826f39a4 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:42.986740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-ebc0ea60-f71b-451e-ad1d-1c620ba6d163 req-6ecea881-d1fe-40a5-9ffd-e3d9826f39a4 service nova] Creating event network-vif-plugged:1be14536-3e2f-4338-b020-de2e2e6fc820 for instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 on hv-cinder-85220 Aug 05 19:52:43.008773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-ebc0ea60-f71b-451e-ad1d-1c620ba6d163 req-6ecea881-d1fe-40a5-9ffd-e3d9826f39a4 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092095 Aug 05 19:52:43.010416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 181/360] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:43.049892 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:43.050799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:43.064859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.065976 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.067131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:43.075740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.077214 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.077827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:43.213547 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:43.223336 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d8cfdbb6-5490-40e5-a91e-85c6809f9b10 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.517876 Aug 05 19:52:43.229651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 180/361] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:42 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:43.234755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-9c22ce2f-bef8-4926-9c5e-c3b5f91bb1e7 req-5df64000-d0a2-4eb8-8895-ead576ae3d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072224de-6d26-42c6-8b85-d68219c9cd8e", "tag": "8102aa30-e00e-4595-a116-c8fc0b7138a1"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:43.254388 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9c22ce2f-bef8-4926-9c5e-c3b5f91bb1e7 req-5df64000-d0a2-4eb8-8895-ead576ae3d65 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.259944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9c22ce2f-bef8-4926-9c5e-c3b5f91bb1e7 req-5df64000-d0a2-4eb8-8895-ead576ae3d65 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.261323 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9c22ce2f-bef8-4926-9c5e-c3b5f91bb1e7 req-5df64000-d0a2-4eb8-8895-ead576ae3d65 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:43.281311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-9c22ce2f-bef8-4926-9c5e-c3b5f91bb1e7 req-5df64000-d0a2-4eb8-8895-ead576ae3d65 service nova] Creating event network-changed:8102aa30-e00e-4595-a116-c8fc0b7138a1 for instance 072224de-6d26-42c6-8b85-d68219c9cd8e on hv-cinder-85220 Aug 05 19:52:43.288147 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-9c22ce2f-bef8-4926-9c5e-c3b5f91bb1e7 req-5df64000-d0a2-4eb8-8895-ead576ae3d65 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057041 Aug 05 19:52:43.289887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 181/362] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:43.422174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:43.423052 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:43.446919 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.448776 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.449453 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:43.451666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.452375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.455965 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:43.613513 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:43.641921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dac63921-25af-4eea-997c-61353d38e78e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1725 microversion: 2.1 time: 0.596517 Aug 05 19:52:43.651207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 182/363] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:43 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1725 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:43.733055 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:43.733893 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:43.744726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.747267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.747940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:43.748860 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.750488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.752030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:43.859300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:43.876003 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-914345e8-b42e-48c5-bfff-13c753842449 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.458165 Aug 05 19:52:43.886658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 182/364] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:43 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:43.940603 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:43.941225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:43.956375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.957997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.961453 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:43.965811 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:43.966240 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:43.966718 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:44.230321 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:44.272668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:44.280934 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:44.286047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9122a9cd-bc67-4665-b727-089cf2ca6d2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.557916 Aug 05 19:52:44.302959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 183/365] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:43 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:44.315044 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:44.316027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:44.324361 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:44.326781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:44.326781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:44.327757 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:44.328552 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:44.340582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:44.514422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:44.528280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2cdf448c-457c-4f32-8ef7-1bd00d1ec461 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.591638 Aug 05 19:52:44.533082 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 183/366] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:43 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:44.682932 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:44.684219 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:44.694294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:44.695935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:44.696861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:44.698860 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:44.699631 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:44.700407 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:44.812939 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:44.842146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-85183000-d14f-40bc-894d-55064cadf1c9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.531814 Aug 05 19:52:44.846940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 184/367] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:44 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:44.919561 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:44.935015 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:44.937371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:44.944603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:44.944603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:44.944603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:44.944603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:44.945045 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.153646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:45.170245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7ad1ee8c-2b21-4cfb-bbea-166e77a6b446 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1702 microversion: 2.1 time: 0.498064 Aug 05 19:52:45.171609 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 184/368] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:44 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1702 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:45.177049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-1b7c25bb-1b51-49ed-8461-6e30795da870 req-ccaab947-8a67-4d70-b0fd-584c6be86ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096fbbf4-4d8a-4e2a-aa55-118994138c19", "name": "network-vif-plugged", "status": "completed", "tag": "22eda304-25c6-40ca-ba58-e4b19b0a7687"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:45.223349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-1b7c25bb-1b51-49ed-8461-6e30795da870 req-ccaab947-8a67-4d70-b0fd-584c6be86ec7 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.225293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-1b7c25bb-1b51-49ed-8461-6e30795da870 req-ccaab947-8a67-4d70-b0fd-584c6be86ec7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.227666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-1b7c25bb-1b51-49ed-8461-6e30795da870 req-ccaab947-8a67-4d70-b0fd-584c6be86ec7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.270853 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-1b7c25bb-1b51-49ed-8461-6e30795da870 req-ccaab947-8a67-4d70-b0fd-584c6be86ec7 service nova] Creating event network-vif-plugged:22eda304-25c6-40ca-ba58-e4b19b0a7687 for instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 on hv-cinder-85220 Aug 05 19:52:45.278895 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-1b7c25bb-1b51-49ed-8461-6e30795da870 req-ccaab947-8a67-4d70-b0fd-584c6be86ec7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105509 Aug 05 19:52:45.279855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 185/369] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:45.301088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-94dc5eba-1ace-4d7c-bc80-c6606480ffd1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:45.328598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94dc5eba-1ace-4d7c-bc80-c6606480ffd1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.329503 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94dc5eba-1ace-4d7c-bc80-c6606480ffd1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.333156 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94dc5eba-1ace-4d7c-bc80-c6606480ffd1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.359988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:45.374455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-497b34dd-fce0-47b1-afba-a9cecee40b5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.455192 Aug 05 19:52:45.378216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 185/370] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:44 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:45.385942 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-9db688de-8371-413e-a6be-12fed498ec7e req-0bb6dd8c-5a9a-4058-aacc-fa21ec5ffb27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75eabf8-c187-4e38-afe7-c8f017f3a3f3", "tag": "2fa04866-048e-4c7e-aa04-cbd556836f35"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:45.396185 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-94dc5eba-1ace-4d7c-bc80-c6606480ffd1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Going to try to start instance {{(pid=124552) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 19:52:45.398880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-9db688de-8371-413e-a6be-12fed498ec7e req-0bb6dd8c-5a9a-4058-aacc-fa21ec5ffb27 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.399623 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-9db688de-8371-413e-a6be-12fed498ec7e req-0bb6dd8c-5a9a-4058-aacc-fa21ec5ffb27 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.400364 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-9db688de-8371-413e-a6be-12fed498ec7e req-0bb6dd8c-5a9a-4058-aacc-fa21ec5ffb27 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.425254 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-9db688de-8371-413e-a6be-12fed498ec7e req-0bb6dd8c-5a9a-4058-aacc-fa21ec5ffb27 service nova] Creating event network-changed:2fa04866-048e-4c7e-aa04-cbd556836f35 for instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 on hv-cinder-85220 Aug 05 19:52:45.434865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-9db688de-8371-413e-a6be-12fed498ec7e req-0bb6dd8c-5a9a-4058-aacc-fa21ec5ffb27 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054715 Aug 05 19:52:45.436022 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 186/371] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:45.473899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:45.475456 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:45.511772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-94dc5eba-1ace-4d7c-bc80-c6606480ffd1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/action" status: 202 len: 0 microversion: 2.1 time: 0.230032 Aug 05 19:52:45.515562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 186/372] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:52:45 2022] POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:52:45.516461 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.516974 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.523921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.525550 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.526291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.527002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.532075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:45.534347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:45.552659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.553313 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.554080 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.556383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.557479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.558504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.823704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:45.840728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-564d21f0-199d-4eef-84f9-715b1cf3baa1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1711 microversion: 2.1 time: 0.319254 Aug 05 19:52:45.841957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 187/373] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:45 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1711 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:45.846049 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:45.859934 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:45.861683 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:45.862744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:45.863375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:45.863714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1ded0588-8347-47a1-9a2f-f2fe8db09a48 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.424573 Aug 05 19:52:45.864802 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 187/374] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:45 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:45.888726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:45.890562 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:45.901445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.901445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.901445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.901445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.902182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.902182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.942840 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.943350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.943803 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:45.944531 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:45.944995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:45.946053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:46.146144 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:46.150482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:46.168010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-da3204ae-cc2f-4aa5-94c1-8ffe8e60d84d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.312130 Aug 05 19:52:46.169078 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-34dc4245-49fa-4e66-8cd5-bca23d9015d7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.287302 Aug 05 19:52:46.169241 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 188/375] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:45 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:46.170287 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 188/376] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:45 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:46.399786 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:46.399997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:46.414741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:46.416218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:46.416921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:46.417956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:46.418643 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:46.419357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:46.653001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:46.660953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-da8bcaf5-9c10-4693-bc29-c7ca18db7ed0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1318 microversion: 2.1 time: 0.265883 Aug 05 19:52:46.661540 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 189/377] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:46 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:46.867471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:46.867471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:46.880581 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:46.880948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:46.881456 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:46.882229 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:46.882992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:46.888548 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:46.889451 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:46.894745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:46.900384 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:46.900959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:46.901413 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:46.902146 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:46.907909 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:46.908325 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:47.121488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:47.131745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-547bc58c-e245-4b2b-a5a0-80a51a391807 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1711 microversion: 2.1 time: 0.272172 Aug 05 19:52:47.138924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 189/378] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:46 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1711 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:47.167056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:47.181315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:47.183569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:47.185366 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0f32e5f1-42ce-4cac-b6aa-59fc4690f25e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.301080 Aug 05 19:52:47.193941 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:47.194894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:47.199890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 190/379] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:46 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:47.210078 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:47.211156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:47.211847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:47.212816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:47.214320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:47.214973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:47.220263 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:47.229042 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:47.260380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:47.265825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:47.266472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:47.267391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:47.267999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:47.268465 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:47.485886 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:47.518282 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f7184ddf-10c0-4279-98ce-091f4e742e3b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.328202 Aug 05 19:52:47.522295 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 190/380] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:47 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:47.545026 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:47.556781 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b88e45b9-2293-4170-a67a-88ebf95c507d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.355108 Aug 05 19:52:47.557357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 191/381] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:47 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:47.687594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:47.688792 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:47.700277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:47.701373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:47.702064 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:47.703278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:47.704452 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:47.705126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:48.126603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:48.141644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-80a18234-6701-4781-a22f-5eec72b79ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1508 microversion: 2.1 time: 0.463487 Aug 05 19:52:48.142246 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 191/382] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:47 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1508 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:48.155256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:48.156494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:48.171860 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:48.172710 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:48.173335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:48.178503 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:48.179551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:48.180869 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:48.215234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:48.216313 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:48.228195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:48.237213 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:48.243695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:48.245226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:48.246079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:48.246837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:48.428101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=4 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:48.455511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=12 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:48.611610 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=20 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:48.693702 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:48.715429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-235908a3-3146-42ff-9d84-b39638aafaec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1711 microversion: 2.1 time: 0.563777 Aug 05 19:52:48.730060 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 192/383] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:48 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1711 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:48.744487 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:48.747420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:48.771493 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:48.772936 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:48.774324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:48.784788 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:48.787871 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:48.791121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:48.986986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:49.009752 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:49.011865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:49.015865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f225c716-ed49-42cb-aed0-61cd34bed88e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.806413 Aug 05 19:52:49.017106 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 192/384] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:48 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:49.041720 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:49.044678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:49.061562 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:49.062454 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:49.063156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:49.064108 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:49.064898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:49.065572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:49.390302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:49.404132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ff69b8b1-1709-45cd-9ddd-f30c2be0e388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.382665 Aug 05 19:52:49.408481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 193/385] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:49 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:49.759923 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:49.760545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:49.776133 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:49.777056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:49.779238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:49.781179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:49.782003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:49.791312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:49.796978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:49.827129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-271b41ac-32b3-4e8c-90f4-b68ea393405e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 1.082446 Aug 05 19:52:49.828845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 193/386] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:48 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:50.054221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:50.056337 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:50.068929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:50.069658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:50.070928 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:50.072415 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:50.073149 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:50.073806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:50.122457 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:50.139967 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-bed105a4-88db-45d1-985d-99d50eb8045d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1711 microversion: 2.1 time: 0.384800 Aug 05 19:52:50.168947 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 194/387] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:49 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1711 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:50.367454 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:50.371617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:50.387833 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:50.390048 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:50.394079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0e3de34b-3025-4d2f-9eef-41c10d94bf2f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.349209 Aug 05 19:52:50.396547 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 194/388] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:50 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:50.438789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:50.439481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:50.454019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:50.454737 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:50.455579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:50.460207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:50.464162 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:50.464688 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:50.694156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:50.697935 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:50.706229 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-aab835eb-bbaf-41e1-be2a-6797980bc7d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.273498 Aug 05 19:52:50.706854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 195/389] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:50 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:50.760781 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-871119c6-c827-4a31-b78d-113fd3f8afce req-d5b7c808-ea12-4845-bfaa-c89418abe548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072224de-6d26-42c6-8b85-d68219c9cd8e", "name": "network-vif-plugged", "status": "completed", "tag": "8102aa30-e00e-4595-a116-c8fc0b7138a1"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:50.771677 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-871119c6-c827-4a31-b78d-113fd3f8afce req-d5b7c808-ea12-4845-bfaa-c89418abe548 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:50.772154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-871119c6-c827-4a31-b78d-113fd3f8afce req-d5b7c808-ea12-4845-bfaa-c89418abe548 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:50.772585 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-871119c6-c827-4a31-b78d-113fd3f8afce req-d5b7c808-ea12-4845-bfaa-c89418abe548 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:50.788412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-871119c6-c827-4a31-b78d-113fd3f8afce req-d5b7c808-ea12-4845-bfaa-c89418abe548 service nova] Creating event network-vif-plugged:8102aa30-e00e-4595-a116-c8fc0b7138a1 for instance 072224de-6d26-42c6-8b85-d68219c9cd8e on hv-cinder-85220 Aug 05 19:52:50.795468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-871119c6-c827-4a31-b78d-113fd3f8afce req-d5b7c808-ea12-4845-bfaa-c89418abe548 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039775 Aug 05 19:52:50.797455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 195/390] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:52:50.853610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:50.854939 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:50.862579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:50.863385 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:50.863990 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:50.865262 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:50.865710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:50.866145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:51.037126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:51.047037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3c6d326e-c7dd-4c69-bfec-9504ea57668b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.198161 Aug 05 19:52:51.048082 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 196/391] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:50 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:51.173080 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:51.173808 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:51.181449 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:51.181950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:51.182520 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:51.183439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:51.184341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:51.184966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:51.347748 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:51.364622 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-04d0899f-7723-41a3-9408-d98b0ea13360 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1711 microversion: 2.1 time: 0.195832 Aug 05 19:52:51.375953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 196/392] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:51 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1711 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:51.421894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:51.422517 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:51.429019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:51.430292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:51.431045 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:51.431931 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:51.432558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:51.433163 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:51.593236 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:51.603108 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:51.605560 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:51.607029 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-61934e59-9a6c-43ec-86a0-86f076e10feb tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.189149 Aug 05 19:52:51.625650 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 197/393] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:51 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:51.730500 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:51.731141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:51.737857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:51.738357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:51.738827 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:51.739739 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:51.740353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:51.740932 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:51.928456 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:51.939894 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-bc1952ab-ce92-471d-be2b-daf4bc6d3f6a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.214824 Aug 05 19:52:51.940828 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 197/394] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:51 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:52.098535 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:52.099983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:52.108126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:52.109041 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:52.109727 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:52.110884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:52.112272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:52.112969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:52.389395 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:52.390429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:52.397460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:52.398172 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:52.398637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:52.399589 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:52.400096 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:52.400668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:52.453317 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:52.465277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-db7b3402-8f0f-45df-aef0-8948d3e9b76a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.391629 Aug 05 19:52:52.481459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 198/395] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:52 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:52.635622 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:52.636399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:52.643205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:52.644085 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:52.644744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:52.645689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:52.646361 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:52.647045 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:52.690398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:52.699661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6185fe52-c826-45cf-8b94-cd0890719933 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1715 microversion: 2.1 time: 0.315154 Aug 05 19:52:52.701790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 198/396] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:52 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1715 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:52.922599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:52.932125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:52.940144 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:52.941372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3d2e18c9-724b-42ab-8e6d-914c5d6646c9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.311839 Aug 05 19:52:52.943490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 199/397] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:52 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:52.968373 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:52.970573 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:52.988310 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:52.989467 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:52.989945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:52.995352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:52.997925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:52.998819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:53.323448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:53.342816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f27be5e8-efc3-43d0-aa0e-a63d274b5686 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.380570 Aug 05 19:52:53.343468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 199/398] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:52 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:53.490841 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:53.491703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:53.503180 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:53.503930 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:53.504550 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:53.505459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:53.505994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:53.506731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:53.709990 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:53.724856 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-eb014ba9-3575-49f0-85a4-09189a96ecd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.240769 Aug 05 19:52:53.739515 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 200/399] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:53 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:53.971592 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:53.972504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:53.981724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:53.982668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:53.983350 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:53.984239 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:53.984703 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:53.985305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:54.177775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:54.188741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:54.190434 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:54.192010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-230e8c9f-a712-4a3c-bc87-5590ac5c801a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.224977 Aug 05 19:52:54.192945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 200/400] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:53 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:54.371578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:54.372432 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:54.380493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:54.381669 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:54.383460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:54.385339 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:54.386137 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:54.386843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:54.568742 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:54.580222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-74c357cf-c3c9-4791-b868-395f69a69a86 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.213457 Aug 05 19:52:54.590940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 201/401] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:54 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:54.749331 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:54.750301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:54.757123 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:54.759405 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:54.760089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:54.761035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:54.761663 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:54.762237 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:55.016472 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-0b507fbe-0b35-48d0-a515-7a65cb6c1b0e req-85e634c8-b86c-4bf8-8fe3-2e635dd10d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75eabf8-c187-4e38-afe7-c8f017f3a3f3", "name": "network-vif-plugged", "status": "completed", "tag": "2fa04866-048e-4c7e-aa04-cbd556836f35"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:55.019814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:55.030714 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4b818ae6-9eea-464a-9034-7b85e3709a0f tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.285872 Aug 05 19:52:55.033055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 201/402] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:54 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:55.038316 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-0b507fbe-0b35-48d0-a515-7a65cb6c1b0e req-85e634c8-b86c-4bf8-8fe3-2e635dd10d2e service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:55.039495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-0b507fbe-0b35-48d0-a515-7a65cb6c1b0e req-85e634c8-b86c-4bf8-8fe3-2e635dd10d2e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:55.043154 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-0b507fbe-0b35-48d0-a515-7a65cb6c1b0e req-85e634c8-b86c-4bf8-8fe3-2e635dd10d2e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:55.067422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-0b507fbe-0b35-48d0-a515-7a65cb6c1b0e req-85e634c8-b86c-4bf8-8fe3-2e635dd10d2e service nova] Creating event network-vif-plugged:2fa04866-048e-4c7e-aa04-cbd556836f35 for instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 on hv-cinder-85220 Aug 05 19:52:55.076219 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-0b507fbe-0b35-48d0-a515-7a65cb6c1b0e req-85e634c8-b86c-4bf8-8fe3-2e635dd10d2e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063018 Aug 05 19:52:55.077473 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 202/403] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:55.217579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:55.218427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:55.226339 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:55.226862 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:55.227319 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:55.228068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:55.228701 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:55.229135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:55.436357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:55.466533 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:55.469847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:55.472759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-419c7f68-0cd2-448e-8dd0-dbc9c5d2c165 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.258878 Aug 05 19:52:55.525761 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 202/404] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:55 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:55.608074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:55.608710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:55.616515 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:55.617686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:55.618181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:55.618944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:55.619465 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:55.619911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:55.840421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:55.848857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fb3afb4d-6a25-4e1e-8f83-600b2f395e3e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.246069 Aug 05 19:52:55.850047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 203/405] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:55 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:52:56.059092 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:56.059721 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:56.066974 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:56.067804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:56.068317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:56.069201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:56.070496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:56.071190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:56.244846 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:56.253287 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-52812de8-5412-467f-a52d-9e670666e0ed tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1556 microversion: 2.1 time: 0.199334 Aug 05 19:52:56.254202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 203/406] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:56 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1556 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:56.279392 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:56.280301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:56.286719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:56.287462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:56.288087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:56.290744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:56.291454 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:56.292014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:56.386256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-404c3942-18cd-4151-a8e6-d344d5d166c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112738 Aug 05 19:52:56.386877 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 204/407] 10.222.0.86 () {58 vars in 1275 bytes} [Fri Aug 5 19:52:56 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:56.552049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:56.552828 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:56.567075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:56.573128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:56.574065 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:56.574935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:56.575608 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:56.576212 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:56.769601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:56.778601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:56.780238 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:56.781901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7721a580-58d2-4b00-be9d-76951946e14f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1740 microversion: 2.20 time: 0.233688 Aug 05 19:52:56.796574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 204/408] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:56 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:56.903141 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:56.903892 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:56.910649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:56.911263 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:56.911866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:56.912777 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:56.913717 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:56.914889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:57.303568 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:57.314022 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f79a7b50-52db-4997-9b37-3eb11aa371ab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1372 microversion: 2.1 time: 0.416774 Aug 05 19:52:57.314707 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 205/409] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:56 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1372 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:57.808826 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:57.809445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:57.816104 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:57.816689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:57.817448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:57.818555 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:57.818555 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:57.818958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:57.894360 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-8e2f070f-533e-4446-a93b-e002d2c7ec52 req-338fea0c-a9f4-4bcb-993d-fde1007f7f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072224de-6d26-42c6-8b85-d68219c9cd8e", "tag": "8102aa30-e00e-4595-a116-c8fc0b7138a1"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:52:57.917483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-8e2f070f-533e-4446-a93b-e002d2c7ec52 req-338fea0c-a9f4-4bcb-993d-fde1007f7f26 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:57.918367 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-8e2f070f-533e-4446-a93b-e002d2c7ec52 req-338fea0c-a9f4-4bcb-993d-fde1007f7f26 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:57.919440 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-8e2f070f-533e-4446-a93b-e002d2c7ec52 req-338fea0c-a9f4-4bcb-993d-fde1007f7f26 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:57.941747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-8e2f070f-533e-4446-a93b-e002d2c7ec52 req-338fea0c-a9f4-4bcb-993d-fde1007f7f26 service nova] Creating event network-changed:8102aa30-e00e-4595-a116-c8fc0b7138a1 for instance 072224de-6d26-42c6-8b85-d68219c9cd8e on hv-cinder-85220 Aug 05 19:52:57.951227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-8e2f070f-533e-4446-a93b-e002d2c7ec52 req-338fea0c-a9f4-4bcb-993d-fde1007f7f26 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063150 Aug 05 19:52:57.952459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 206/410] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:52:57.998214 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:58.008102 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:58.009876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:58.011155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9e4d971a-2ddc-48ba-9675-e440bfb955e8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1722 microversion: 2.20 time: 0.207656 Aug 05 19:52:58.011734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 205/411] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:57 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:52:58.337102 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:58.338075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:58.346931 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:58.375718 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:58.376704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:58.379169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:58.381278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:58.391096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:58.584146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:58.592549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-97c798ee-84b8-418f-bf25-f88f87042d58 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1566 microversion: 2.1 time: 0.260858 Aug 05 19:52:58.593314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 207/412] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:52:58 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1566 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:52:58.615090 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:58.616331 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:58.624491 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:58.625226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:58.625837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:58.626785 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:58.627433 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:58.628086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:58.808988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ada5aef5-c47f-4c4b-b92f-f0afc40ceea3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199275 Aug 05 19:52:58.818118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 206/413] 10.222.0.86 () {58 vars in 1275 bytes} [Fri Aug 5 19:52:58 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:52:59.047046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:52:59.048106 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:52:59.067087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:59.067851 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:59.068461 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:59.069382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:52:59.070216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:52:59.070868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:52:59.376479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:59.391115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:59.394571 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:52:59.396242 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ddd3c490-f6ac-46c9-8ee3-61ea5878b709 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1722 microversion: 2.20 time: 0.357169 Aug 05 19:52:59.405459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 208/414] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:52:59 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:00.059818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-7d98ccb5-ab27-477e-9363-c7ea7eebad4a req-dbea24a4-4c2f-4616-bc68-880a5bb55f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75eabf8-c187-4e38-afe7-c8f017f3a3f3", "tag": "2fa04866-048e-4c7e-aa04-cbd556836f35"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:00.073467 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-7d98ccb5-ab27-477e-9363-c7ea7eebad4a req-dbea24a4-4c2f-4616-bc68-880a5bb55f84 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:00.074228 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-7d98ccb5-ab27-477e-9363-c7ea7eebad4a req-dbea24a4-4c2f-4616-bc68-880a5bb55f84 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:00.074974 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-7d98ccb5-ab27-477e-9363-c7ea7eebad4a req-dbea24a4-4c2f-4616-bc68-880a5bb55f84 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:00.087432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-7d98ccb5-ab27-477e-9363-c7ea7eebad4a req-dbea24a4-4c2f-4616-bc68-880a5bb55f84 service nova] Creating event network-changed:2fa04866-048e-4c7e-aa04-cbd556836f35 for instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 on hv-cinder-85220 Aug 05 19:53:00.093370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-7d98ccb5-ab27-477e-9363-c7ea7eebad4a req-dbea24a4-4c2f-4616-bc68-880a5bb55f84 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042648 Aug 05 19:53:00.094089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 207/415] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:53:00.434922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:00.435918 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:00.443322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:00.443818 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:00.444263 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:00.445131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:00.445825 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:00.446266 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:00.618752 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:00.629279 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:00.631594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:00.633070 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2253e90f-6d46-4c00-a38e-be7f9bc0b6fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1722 microversion: 2.20 time: 0.204963 Aug 05 19:53:00.633720 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 209/416] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:00 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:00.935670 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-062defdc-2079-4fc8-9bc2-4f6ab6b763df req-23f02c61-8c3d-4fcc-9832-4cbdb57506d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096fbbf4-4d8a-4e2a-aa55-118994138c19", "name": "network-vif-unplugged", "status": "completed", "tag": "22eda304-25c6-40ca-ba58-e4b19b0a7687"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:00.945765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-062defdc-2079-4fc8-9bc2-4f6ab6b763df req-23f02c61-8c3d-4fcc-9832-4cbdb57506d7 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:00.946281 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-062defdc-2079-4fc8-9bc2-4f6ab6b763df req-23f02c61-8c3d-4fcc-9832-4cbdb57506d7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:00.946745 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-062defdc-2079-4fc8-9bc2-4f6ab6b763df req-23f02c61-8c3d-4fcc-9832-4cbdb57506d7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:00.958018 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-062defdc-2079-4fc8-9bc2-4f6ab6b763df req-23f02c61-8c3d-4fcc-9832-4cbdb57506d7 service nova] Creating event network-vif-unplugged:22eda304-25c6-40ca-ba58-e4b19b0a7687 for instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 on hv-cinder-85220 Aug 05 19:53:00.964752 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-062defdc-2079-4fc8-9bc2-4f6ab6b763df req-23f02c61-8c3d-4fcc-9832-4cbdb57506d7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033176 Aug 05 19:53:00.965421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 208/417] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:53:01.657123 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:01.657733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:01.666939 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:01.667364 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:01.667820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:01.668542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:01.668994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:01.669449 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:01.856869 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:01.875836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:01.878002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:01.880471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9160a98c-3c95-44ff-ae9c-1f5dfcf3bbfe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1722 microversion: 2.20 time: 0.227101 Aug 05 19:53:01.883634 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 210/418] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:01 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:02.912887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:02.913826 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:02.920546 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:02.921047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:02.921485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:02.922200 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:02.922709 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:02.923160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:03.086589 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:03.095184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:03.096687 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:03.097840 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5d6b8994-0cb6-4a57-ab37-e6c433c34765 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1665 microversion: 2.20 time: 0.190155 Aug 05 19:53:03.098439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 209/419] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:02 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1665 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:53:03.120768 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bd6e06e-1571-4bb6-b8cb-a3a1c6a545ac"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:03.123254 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:03.129786 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:03.130269 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:03.130735 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:03.131578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:03.132741 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:03.133179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:03.440332 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:03.458532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-560f3228-a5a1-4cda-829a-d098740f0cd0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341966 Aug 05 19:53:03.465552 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 211/420] 10.222.0.86 () {62 vars in 1364 bytes} [Fri Aug 5 19:53:03 2022] POST /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:53:03.593383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:03.593991 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:03.601658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:03.602175 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:03.602605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:03.603347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:03.603806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:03.604238 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:03.651867 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124552) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 19:53:03.730950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-74847bd4-07a5-459d-acbb-c5a2f53e15d2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/action" status: 202 len: 0 microversion: 2.20 time: 0.138539 Aug 05 19:53:03.730950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 210/421] 10.222.0.86 () {62 vars in 1319 bytes} [Fri Aug 5 19:53:03 2022] POST /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:53:03.737055 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:03.737778 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:03.745661 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:03.746817 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:03.746968 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:03.747785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:03.748204 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:03.748841 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:03.907671 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:03.926184 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:03.928895 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:03.931122 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-faae1334-4231-41f4-9df0-717031b8a83d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1751 microversion: 2.20 time: 0.198010 Aug 05 19:53:03.932014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 212/422] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:03 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:04.958731 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:04.959299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:04.967301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:04.967809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:04.968322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:04.968996 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:04.969454 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:04.970100 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:05.144735 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:05.155042 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:05.156668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:05.157880 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-1da04f91-06df-4602-8560-767d286cc99c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1751 microversion: 2.20 time: 0.204379 Aug 05 19:53:05.158448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 211/423] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:04 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:06.184714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:06.185446 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:06.191493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:06.192055 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:06.192495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:06.193206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:06.193652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:06.194075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:06.354985 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:06.363982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:06.365491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:06.367438 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d59cae49-5e3b-4ea9-8c61-2d22ee37e487 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.188486 Aug 05 19:53:06.368217 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 213/424] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:06 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:07.394145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:07.394893 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:07.402753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:07.403250 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:07.404546 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:07.405275 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:07.405776 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:07.406201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:07.565750 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:07.568217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:07.577032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:07.578548 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:07.579751 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-12681d3e-c0a0-4637-86b2-ab84865c12e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.189761 Aug 05 19:53:07.580316 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 212/425] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:07 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:08.610463 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:08.611397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:08.621023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:08.621864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:08.622543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:08.623445 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:08.624099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:08.624738 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:08.803018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:08.812603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:08.814122 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:08.815350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a2d05531-8e50-4585-9e9a-194d39e67219 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.213367 Aug 05 19:53:08.816221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 214/426] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:08 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:09.841211 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:09.842554 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:09.845408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:09.855020 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:09.855528 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:09.855960 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:09.856837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:09.857447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:09.858305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:10.045325 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:10.070512 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:10.075668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:10.077354 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ce60cf38-bddd-4c59-be71-3417d26c09b3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.242107 Aug 05 19:53:10.097637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 213/427] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:09 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:11.104518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:11.105139 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:11.107516 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=82 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:11.112860 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:11.113465 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:11.113908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:11.114751 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:11.115399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:11.116435 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:11.283493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:11.293009 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:11.294532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:11.295739 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-28d587f4-2a2b-4e7d-a0f7-411e54ab31c8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.195738 Aug 05 19:53:11.296298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 215/428] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:11 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:12.321386 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:12.322018 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:12.329676 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:12.330174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:12.330615 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:12.331661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:12.332125 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:12.332604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:12.498999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:12.508815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:12.510321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:12.511992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5c12d3f2-4ac5-4229-a162-1388a94bf34b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.195173 Aug 05 19:53:12.512554 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 214/429] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:12 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:13.539161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:13.539828 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:13.546857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:13.547353 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:13.547790 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:13.548506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:13.548963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:13.549384 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:13.706566 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:13.716233 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:13.717770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:13.718984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4e48544e-d806-4416-8c88-269b1e4a561b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.184051 Aug 05 19:53:13.719554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 216/430] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:13 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:14.710328 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 19:53:14.711074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Fri Aug 5 19:53:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 19:53:14.745408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:14.746034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:14.753677 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:14.754267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:14.754823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:14.755625 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:14.756157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:14.757225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:14.909226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:14.920149 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:14.921668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:14.922883 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-644fdbb9-ef1c-4e21-a024-b6d2d083cd0f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.183175 Aug 05 19:53:14.923451 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 215/431] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:14 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:15.947335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:15.948030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:15.954402 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:15.954920 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:15.955350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:15.956052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:15.956506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:15.956926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:16.114273 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:16.126159 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:16.128945 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:16.129117 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e5b74b4d-f9ed-4f93-869c-abf27d017c06 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.186125 Aug 05 19:53:16.129636 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 217/432] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:15 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:16.613491 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e57b6f04-f7ae-4b26-a48f-82d332a91d11", "device": "/dev/sdb"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:16.616510 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:16.623293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:16.623788 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:16.624232 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:16.624945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:16.625420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:16.625830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:17.153894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:17.154504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:17.161837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:17.162324 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:17.162825 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:17.163529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:17.163984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:17.164403 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:17.309446 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:17.320085 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:17.321605 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:17.322873 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4a9e06a0-82ca-4e15-8675-830def568e15 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.173143 Aug 05 19:53:17.323380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 218/433] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:17 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:53:18.347019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:18.347722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:18.354155 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:18.354653 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:18.355105 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:18.355800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:18.356252 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:18.356676 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:18.508708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:18.517613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:18.519251 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:18.520448 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-210c26a0-d0ff-4215-8bbe-6b3b872901a5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.177458 Aug 05 19:53:18.521005 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 219/434] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:18 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:53:19.547172 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:19.547848 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:19.554928 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:19.555423 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:19.555856 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:19.557072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:19.557072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:19.557430 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:19.720847 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:19.731364 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:19.733024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:19.734354 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5b411b70-ed34-47fd-a24d-9304a510ac5b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.191053 Aug 05 19:53:19.735198 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 220/435] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:19 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:53:19.738312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b4a2e91d-bbae-4753-8ffa-4441a4a396f8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "POST /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.128777 Aug 05 19:53:19.738969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 216/436] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:53:16 2022] POST /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5/os-volume_attachments => generated 194 bytes in 3130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:53:20.759691 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:20.760279 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:20.766640 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:20.767138 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:20.767565 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:20.768259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:20.768707 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:20.769128 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:20.906756 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:20.916580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:20.918103 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:20.919306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e3b2f997-75d1-42f1-a7b5-bc13119a1a9e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.164229 Aug 05 19:53:20.919861 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 221/437] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:20 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:21.944992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:21.945992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:21.953352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:21.953835 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:21.954265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:21.954987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:21.955436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:21.955854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:22.093581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:22.102291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:22.103846 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:22.105006 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7a4159cb-5e29-4490-b755-348469939f4f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.165869 Aug 05 19:53:22.105570 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 217/438] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:21 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:53:23.129043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:23.129700 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:23.137145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:23.137629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:23.138060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:23.138783 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:23.139235 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:23.139660 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:23.285082 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:23.294029 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:23.295576 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:23.296737 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9cc98489-a50a-481a-b3af-fb2ae7973108 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.171711 Aug 05 19:53:23.297292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 222/439] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:23 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:24.320463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:24.321081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:24.327648 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:24.328136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:24.328574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:24.329271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:24.329728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:24.330161 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:24.467285 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:24.477004 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:24.478965 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:24.480163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a56ceb6e-f9de-4a91-baea-1e24e420c1f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.163852 Aug 05 19:53:24.480733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 218/440] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:24 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:25.503716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:25.504577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:25.512118 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:25.512598 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:25.513027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:25.513723 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:25.514170 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:25.514588 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:25.644046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:25.653214 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:25.654749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:25.655902 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0f8a540a-9d69-44b6-848d-e8e8faedf430 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.156417 Aug 05 19:53:25.656463 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 223/441] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:25 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:26.680954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:26.681539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:26.687986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:26.688472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:26.688909 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:26.689601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:26.690054 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:26.690480 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:26.822839 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:26.831378 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:26.832895 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:26.834815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ddb54a1d-1e8f-4121-9a15-f6539ef01b9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.158036 Aug 05 19:53:26.835127 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 219/442] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:26 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:27.857752 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:27.858344 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:27.864822 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:27.866358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:27.867017 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:27.867768 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:27.868269 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:27.868731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:28.003395 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:28.012186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:28.013672 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:28.014849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1990254d-a486-498e-bce8-cfa8962e5f9f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.161424 Aug 05 19:53:28.015403 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 224/443] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:27 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:29.000686 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-e4397803-c030-4338-9165-878e493834c9 req-79ca1990-a806-4787-8346-b4cead8880a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096fbbf4-4d8a-4e2a-aa55-118994138c19", "name": "network-vif-plugged", "status": "completed", "tag": "22eda304-25c6-40ca-ba58-e4b19b0a7687"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:29.012505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e4397803-c030-4338-9165-878e493834c9 req-79ca1990-a806-4787-8346-b4cead8880a3 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:29.013349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e4397803-c030-4338-9165-878e493834c9 req-79ca1990-a806-4787-8346-b4cead8880a3 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:29.013798 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-e4397803-c030-4338-9165-878e493834c9 req-79ca1990-a806-4787-8346-b4cead8880a3 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:29.025706 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-e4397803-c030-4338-9165-878e493834c9 req-79ca1990-a806-4787-8346-b4cead8880a3 service nova] Creating event network-vif-plugged:22eda304-25c6-40ca-ba58-e4b19b0a7687 for instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 on hv-cinder-85220 Aug 05 19:53:29.031081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-e4397803-c030-4338-9165-878e493834c9 req-79ca1990-a806-4787-8346-b4cead8880a3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034099 Aug 05 19:53:29.032047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 220/444] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:53:29.038977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:29.039600 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:29.045979 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:29.046493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:29.046955 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:29.047649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:29.048109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:29.048518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:29.189407 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:29.199752 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:29.201272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:29.202443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1b2ea04b-e1b0-4903-95b4-da6dc5c3f995 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.168874 Aug 05 19:53:29.203044 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 225/445] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:29 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:30.230082 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:30.231578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:30.248063 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:30.249091 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:30.249883 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:30.250747 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:30.251216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:30.251650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:30.403866 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:30.413256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:30.414778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:30.415936 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-93a62cb2-b577-460f-b4da-eb7be8a43343 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.193970 Aug 05 19:53:30.416491 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 221/446] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:30 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:53:31.440105 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:31.440727 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:31.448226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:31.448712 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:31.449146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:31.449845 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:31.450289 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:31.450748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:31.605816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:31.614881 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:31.616543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:31.617721 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4af57fcf-36c9-46fe-9397-fe62514c1178 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.181579 Aug 05 19:53:31.618278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 226/447] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:31 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:32.641044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:32.641660 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:32.648857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:32.649347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:32.649780 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:32.650480 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:32.650968 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:32.651398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:32.795045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:32.806448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:32.807992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:32.809150 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-44e5bc71-2e1e-4877-8081-f617abb5ec88 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.172041 Aug 05 19:53:32.809722 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 222/448] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:32 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:53:33.832875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:33.833484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:33.840988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:33.841477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:33.841913 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:33.842663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:33.843105 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:33.843537 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:33.846142 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:33.986176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:33.995494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:33.997007 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:33.998191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8240268b-6f3a-4a65-9df8-6628ff4d367d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.169522 Aug 05 19:53:33.998771 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 227/449] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:33 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:35.022306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:35.023138 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:35.029498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:35.029978 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:35.030408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:35.031118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:35.031566 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:35.031987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:35.164501 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:35.172883 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:35.174379 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:35.175577 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b2bd2593-9512-4724-a3a2-406f4f1707a0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.158159 Aug 05 19:53:35.176126 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 223/450] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:35 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:36.200016 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:36.200644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:36.207238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:36.207723 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:36.208160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:36.208865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:36.209960 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:36.210435 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:36.343753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:36.352288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:36.353781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:36.355065 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-07cd9ba1-ff21-4916-9a53-23e8f82050c6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.159221 Aug 05 19:53:36.355616 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 228/451] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:36 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:37.377834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:37.378594 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:37.385467 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:37.385949 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:37.386380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:37.387112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:37.387564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:37.387984 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:37.544404 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:37.553097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:37.554895 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:37.556063 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-bc7976ff-0b12-4547-ab00-ccdde810128d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.182237 Aug 05 19:53:37.556630 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 224/452] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:37 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:38.579673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:38.580320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:38.587268 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:38.587746 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:38.588179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:38.588868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:38.589326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:38.589747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:38.720854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:38.730528 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:38.732092 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:38.733296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f90e2b66-1f8c-4d67-94cb-072b673aaaed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.157528 Aug 05 19:53:38.733786 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 229/453] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:38 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:39.756837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:39.757902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:39.764027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:39.764506 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:39.764939 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:39.765623 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:39.766110 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:39.766530 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:39.897664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:39.900028 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:39.908878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:39.910393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:39.911661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7cd0d209-91e1-44b0-a460-2c65e0d40488 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1809 microversion: 2.20 time: 0.159384 Aug 05 19:53:39.912780 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 225/454] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:39 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:40.935429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:40.936041 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:40.942418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:40.942936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:40.943397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:40.944088 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:40.944549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:40.944963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:41.312252 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:41.322540 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:41.324081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:41.325283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d4049f30-cda2-4ba6-9dd7-530efb346443 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1796 microversion: 2.20 time: 0.393732 Aug 05 19:53:41.326018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 230/455] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:53:40 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1796 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:53:44.658355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:44.658990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:44.661591 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=26 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:44.667890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:44.668548 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:44.668988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:44.669685 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:44.670164 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:44.670591 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:44.799374 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lazy-loading 'services' on Instance uuid cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:53:44.913413 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8dc54d41-da50-42fe-8b5c-ad4a64ee29ce tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5/os-volume_attachments/e57b6f04-f7ae-4b26-a48f-82d332a91d11" status: 202 len: 0 microversion: 2.1 time: 0.257766 Aug 05 19:53:44.914034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 226/456] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:53:44 2022] DELETE /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5/os-volume_attachments/e57b6f04-f7ae-4b26-a48f-82d332a91d11 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:53:47.103373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:47.103884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:47.105905 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=32 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:47.111149 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:47.111635 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:47.112072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:47.112765 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:47.113222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:47.113646 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:47.138431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Going to try to terminate instance {{(pid=124553) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:53:47.229202 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ddc7e0f9-8d2f-415b-aafd-c2555147fc5f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 204 len: 0 microversion: 2.1 time: 0.130698 Aug 05 19:53:47.229924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 231/457] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:53:47 2022] DELETE /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:53:47.240238 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:47.241005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:47.247863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:47.248354 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:47.248796 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:47.249498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:47.249958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:47.250390 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:47.406378 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:47.414845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e0e69392-f8d7-4e33-a666-29b56c98693c tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1514 microversion: 2.1 time: 0.180075 Aug 05 19:53:47.415417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 227/458] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:53:47 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:53:48.436717 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:48.437441 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:48.444625 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:48.445102 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:48.445536 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:48.446224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:48.446695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:48.447117 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:48.581201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:48.588837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dfc5c8cd-2b6c-4c54-bc74-7d8224fb0d0b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1514 microversion: 2.1 time: 0.156360 Aug 05 19:53:48.589408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 232/459] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:53:48 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:53:49.609750 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:49.610367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:49.616862 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:49.617350 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:49.617795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:49.618493 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:49.618968 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:49.619399 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:49.818863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:49.826562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4bf7a950-761a-4f3b-a5d6-24562bea214d tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1514 microversion: 2.1 time: 0.220815 Aug 05 19:53:49.827174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 228/460] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:53:49 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:53:50.375933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-8486bd21-f2f8-41af-88b2-38fcc828f9ff req-ee0a64e4-04e0-4875-8153-730dae9ccea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3c8e06-58d8-4b20-b8fc-0eb1093446a5", "name": "network-vif-deleted", "tag": "1be14536-3e2f-4338-b020-de2e2e6fc820"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:50.390709 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-8486bd21-f2f8-41af-88b2-38fcc828f9ff req-ee0a64e4-04e0-4875-8153-730dae9ccea7 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:50.391683 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-8486bd21-f2f8-41af-88b2-38fcc828f9ff req-ee0a64e4-04e0-4875-8153-730dae9ccea7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:50.392245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-8486bd21-f2f8-41af-88b2-38fcc828f9ff req-ee0a64e4-04e0-4875-8153-730dae9ccea7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:50.408292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-8486bd21-f2f8-41af-88b2-38fcc828f9ff req-ee0a64e4-04e0-4875-8153-730dae9ccea7 service nova] Creating event network-vif-deleted:1be14536-3e2f-4338-b020-de2e2e6fc820 for instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 on hv-cinder-85220 Aug 05 19:53:50.413446 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-8486bd21-f2f8-41af-88b2-38fcc828f9ff req-ee0a64e4-04e0-4875-8153-730dae9ccea7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041594 Aug 05 19:53:50.414433 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 233/461] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:53:50.848757 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:50.849460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:50.856640 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:50.857131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:50.857581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:50.858290 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:50.858786 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:50.859216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:50.892797 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:50.893275 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:50.893716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:50.894173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lazy-loading 'fault' on Instance uuid cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:53:50.938895 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:50.947759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-65365145-9e41-476b-a58f-2e4466be14c7 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 200 len: 1308 microversion: 2.1 time: 0.102878 Aug 05 19:53:50.948335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 229/462] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:53:50 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:53:51.974981 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:51.975816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: cf3c8e06-58d8-4b20-b8fc-0eb1093446a5] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:51.982367 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:51.982889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:51.983336 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:51.984035 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:51.984493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:51.984924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:52.009669 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] HTTP exception thrown: Instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 could not be found. Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Request method failure captured: Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 HTTP/1.1 Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XT4x5aowKvwkIqK7nkk9zdHjj_iu1QBV_M0wSNViP3nxbSgduRRjahdLQdvWusTZWLA7LbAmsQBnSJJtujedJDWIEJj5ith0JH5ZW1LHOO6CNvTsSBg5u4vaMEMaYdrV5IjcEZ_Pb1l0AP5EF9lPEwUU65MxeCBovb-H-v-uxjTPUo Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 018e12e98f1143d6acaf348cfea45763 Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1603621904 Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:53:52.011409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/018e12e98f1143d6acaf348cfea45763"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/018e12e98f1143d6acaf348cfea45763"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_018e12e98f1143d6acaf348cfea45763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/018e12e98f1143d6acaf348cfea45763"}]}] Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesSnapshotTestJSON-1603621904 Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 018e12e98f1143d6acaf348cfea45763 Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1603621904 Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesSnapshotTestJSON-1603621904-project Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: acfba24ac674454d86e415b38c0c4618 Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesSnapshotTestJSON-1603621904-project Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 could not be found. Aug 05 19:53:52.012899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'cf3c8e06-58d8-4b20-b8fc-0eb1093446a5'} Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 could not be found. Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:53:52.013662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 could not be found. Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 could not be found. Aug 05 19:53:52.014983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:53:52.016369 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Returning 404 to user: Instance cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:53:52.016369 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c4812356-a45f-4bde-a733-764042cc350b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5" status: 404 len: 111 microversion: 2.1 time: 0.045378 Aug 05 19:53:52.016369 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 234/463] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:53:51 2022] GET /compute/v2.1/servers/cf3c8e06-58d8-4b20-b8fc-0eb1093446a5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:53:55.524148 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:55.524148 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:55.528433 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:55.528940 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:55.529389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:55.530105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:55.530569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:55.531056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:55.614263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lazy-loading 'services' on Instance uuid 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:53:55.687794 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c5383f4b-1785-491b-83c4-ee779e479471 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/os-volume_attachments/0dd24e06-9dfd-4aac-8ff9-aaec7c8f9845" status: 202 len: 0 microversion: 2.1 time: 0.171559 Aug 05 19:53:55.688389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 230/464] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:53:55 2022] DELETE /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/os-volume_attachments/0dd24e06-9dfd-4aac-8ff9-aaec7c8f9845 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:53:56.816320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-05b6bd05-115e-4364-a550-063e0e49d748 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:56.824824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b6bd05-115e-4364-a550-063e0e49d748 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:56.825805 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b6bd05-115e-4364-a550-063e0e49d748 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:56.826420 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b6bd05-115e-4364-a550-063e0e49d748 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:56.889083 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-05b6bd05-115e-4364-a550-063e0e49d748 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Going to try to stop instance {{(pid=124553) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 19:53:56.934988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-05b6bd05-115e-4364-a550-063e0e49d748 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/action" status: 202 len: 0 microversion: 2.1 time: 0.122594 Aug 05 19:53:56.935597 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 235/465] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:53:56 2022] POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:53:56.945121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:56.945830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:56.951997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:56.952485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:56.953126 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:56.953828 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:56.954457 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:56.955072 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:57.093224 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:57.101490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6a61f9e0-8af0-4434-bb5e-3668d7009d2b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.161389 Aug 05 19:53:57.102071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 231/466] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:53:56 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:53:58.124033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:58.124678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:58.131197 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:58.131687 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:58.132131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:58.132927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:58.133384 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:58.133812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:58.270439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:58.278143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-045d315a-ff59-4d31-8c5f-871a5a91c5e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.159040 Aug 05 19:53:58.278733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 236/467] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:53:58 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:53:59.287739 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1814c80-35c1-487f-9219-8524f85f778d"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:53:59.290199 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:59.297126 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:59.297618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:59.298093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:59.298797 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:59.299302 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:59.299983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:59.300504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:53:59.301493 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:53:59.308763 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:59.309254 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:59.309694 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:59.310401 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:53:59.310885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:53:59.311338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:53:59.453121 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:53:59.461887 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dc463918-6a12-4efc-b1ea-e798e1187453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.166430 Aug 05 19:53:59.462473 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 237/468] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:53:59 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:00.483087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:00.483821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:00.490745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:00.491229 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:00.491666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:00.492356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:00.492810 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:00.493234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:00.632609 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:00.640357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-83b4f6ff-03a0-4cfc-8e25-d8a1755dcde9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.161078 Aug 05 19:54:00.640918 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 238/469] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:00 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:00.728136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ce3c4336-e606-463d-acc1-2fe6336c94b3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.444668 Aug 05 19:54:00.728913 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 232/470] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:53:59 2022] POST /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments => generated 194 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:54:01.661691 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:01.662290 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:01.669485 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:01.669977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:01.670419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:01.671151 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:01.671612 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:01.672037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:01.808994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:01.816896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e8923c7a-945e-467d-8d8b-e94f441c1fbe tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.159163 Aug 05 19:54:01.817477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 239/471] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:01 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:01.945058 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-283232244", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "networks": [{"uuid": "80ecba96-3387-44f7-a5ab-1098b6a2ba73"}]}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:02.003637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] validate_networks() for [('80ecba96-3387-44f7-a5ab-1098b6a2ba73', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:54:02.391250 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:54:02.391681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:54:02.392191 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:54:02.392605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:54:02.393271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:54:02.402656 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:02.403141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:02.403581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:02.404313 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:02.404780 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:02.405213 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:02.422294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Getting quotas for project 018e12e98f1143d6acaf348cfea45763. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:54:02.426390 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Getting quotas for user acfba24ac674454d86e415b38c0c4618 and project 018e12e98f1143d6acaf348cfea45763. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:54:02.438523 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:54:02.440903 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:54:02.494986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f8946e30-b38e-4fa9-9fcf-43297612dfeb tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554201 Aug 05 19:54:02.498697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 233/472] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:54:02.513080 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9827414a-b292-4a65-83aa-5ac147649142 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:02.513809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9827414a-b292-4a65-83aa-5ac147649142 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:02.578709 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9827414a-b292-4a65-83aa-5ac147649142 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:02.596304 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9827414a-b292-4a65-83aa-5ac147649142 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1218 microversion: 2.1 time: 0.089401 Aug 05 19:54:02.597152 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 240/473] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:02 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:02.845214 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:02.846126 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:02.855440 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:02.856143 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:02.856684 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:02.857699 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:02.857998 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:02.858496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:03.016175 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:03.025616 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2ca08baa-184a-4017-be38-24654062f780 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.184767 Aug 05 19:54:03.026206 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 234/474] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:02 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:03.619814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:03.620748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:03.627291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:03.627909 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:03.628565 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:03.629341 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:03.630014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:03.630503 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:03.703605 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:03.712227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3c54b166-716d-440e-86ba-52694e9c8657 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1288 microversion: 2.1 time: 0.097598 Aug 05 19:54:03.712811 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 241/475] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:03 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:04.047955 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:04.048561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:04.056689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:04.057187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:04.057634 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:04.058360 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:04.058857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:04.059296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:04.267125 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:04.277202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d38d7817-4745-431b-8b0e-104082b3f715 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.231542 Aug 05 19:54:04.277202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 235/476] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:04 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:04.733618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:04.734410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:04.742005 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:04.742594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:04.743070 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:04.743782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:04.744242 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:04.744763 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:04.747659 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:04.892649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:04.901264 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c74ce227-ca07-4100-801a-0cb418e55ea9 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1318 microversion: 2.1 time: 0.171546 Aug 05 19:54:04.902046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 242/477] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:04 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:05.005651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-f6b60bc7-d3a0-4267-be12-98336ba9d0aa req-a82127a1-c665-466f-969c-83939ad53225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81773ee2-5bed-4fab-919c-792a6a2878cf", "tag": "1a1c1f16-2915-4829-ae7b-b060500e16cd"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:05.017459 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f6b60bc7-d3a0-4267-be12-98336ba9d0aa req-a82127a1-c665-466f-969c-83939ad53225 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:05.017997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f6b60bc7-d3a0-4267-be12-98336ba9d0aa req-a82127a1-c665-466f-969c-83939ad53225 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:05.018377 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f6b60bc7-d3a0-4267-be12-98336ba9d0aa req-a82127a1-c665-466f-969c-83939ad53225 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:05.031827 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-f6b60bc7-d3a0-4267-be12-98336ba9d0aa req-a82127a1-c665-466f-969c-83939ad53225 service nova] Creating event network-changed:1a1c1f16-2915-4829-ae7b-b060500e16cd for instance 81773ee2-5bed-4fab-919c-792a6a2878cf on hv-cinder-85220 Aug 05 19:54:05.039921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-f6b60bc7-d3a0-4267-be12-98336ba9d0aa req-a82127a1-c665-466f-969c-83939ad53225 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039664 Aug 05 19:54:05.040892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 236/478] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:05.297371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:05.298087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:05.306477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:05.306940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:05.307372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:05.308081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:05.308522 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:05.308938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:05.452182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:05.460613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6c117a68-01f4-4eb4-b328-09f8e0f8ef85 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.166504 Aug 05 19:54:05.461319 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 243/479] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:05 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:05.925412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:05.926118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:05.932815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:05.933307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:05.933747 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:05.934452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:05.934945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:05.935442 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.076514 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:06.095546 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c6f97737-b02f-4680-8ffe-cbf55eff6cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1318 microversion: 2.1 time: 0.174829 Aug 05 19:54:06.096871 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 237/480] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:05 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:06.352073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:06.352643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:06.359385 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.359881 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.360315 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.361034 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.361486 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.361908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.390393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-75e52ced-d743-443a-a248-d96f5580ca6d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e/ips" status: 200 len: 150 microversion: 2.1 time: 0.043204 Aug 05 19:54:06.391011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 244/481] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:54:06 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:06.403249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90ab3fa6-9619-4d7b-acf6-a635b31113af"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:06.405792 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:06.412347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.413153 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.413671 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.414392 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.414887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.415317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.488576 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:06.489194 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:06.497485 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.497978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.498439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.499186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.499645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.500071 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.514549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Invalid volume: volume 90ab3fa6-9619-4d7b-acf6-a635b31113af is already attached to instances: 0f41d629-ef18-4686-bf58-6b13e25fe71d Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: POST /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e/os-volume_attachments HTTP/1.1 Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 74 Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:54:06.516443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {"volumeAttachment": {"volumeId": "90ab3fa6-9619-4d7b-acf6-a635b31113af"}} Aug 05 19:54:06.518025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Invalid volume: volume 90ab3fa6-9619-4d7b-acf6-a635b31113af is already attached to instances: 0f41d629-ef18-4686-bf58-6b13e25fe71d Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'server_id': '072224de-6d26-42c6-8b85-d68219c9cd8e', 'body': {'volumeAttachment': {'volumeId': '90ab3fa6-9619-4d7b-acf6-a635b31113af'}}} Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 90ab3fa6-9619-4d7b-acf6-a635b31113af is already attached to instances: 0f41d629-ef18-4686-bf58-6b13e25fe71d Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:06.518959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 90ab3fa6-9619-4d7b-acf6-a635b31113af is already attached to instances: 0f41d629-ef18-4686-bf58-6b13e25fe71d Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:06.520324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:06.521770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:06.521770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:54:06.521770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:54:06.521770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 90ab3fa6-9619-4d7b-acf6-a635b31113af is already attached to instances: 0f41d629-ef18-4686-bf58-6b13e25fe71d Aug 05 19:54:06.521770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:06.521770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 400 to user: Invalid volume: volume 90ab3fa6-9619-4d7b-acf6-a635b31113af is already attached to instances: 0f41d629-ef18-4686-bf58-6b13e25fe71d {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:54:06.521770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4a3a235c-a487-4a20-b889-3cd1596a92be tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118859 Aug 05 19:54:06.521770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 238/482] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:54:06 2022] POST /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 19:54:06.527438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:06.527944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:06.535335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.536079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.536264 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.536967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.537705 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.537705 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.576931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:54:06.612613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:06.665793 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:06.672073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dc03a0d4-0ed9-42ed-9f94-1173c47d1f21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 204 len: 0 microversion: 2.1 time: 0.148157 Aug 05 19:54:06.673660 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 239/483] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:54:06 2022] DELETE /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:54:06.680904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b1b79306-085a-41d8-878d-020e78cbebf8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.191276 Aug 05 19:54:06.680904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 245/484] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:06 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:06.683659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:06.684364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:06.691131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.691683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.691852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.692538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:06.692892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:06.695022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:06.845940 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:06.857893 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-276c5294-6575-47b6-a409-956c2630c443 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1681 microversion: 2.1 time: 0.179926 Aug 05 19:54:06.858504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 240/485] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:06 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:07.118329 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:07.118996 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:07.125343 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:07.125833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:07.126277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:07.127157 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:07.127614 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:07.128043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:07.278989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:07.288788 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-da22f5ed-16a0-4cf7-a57b-d8354f7f65bc tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1318 microversion: 2.1 time: 0.175468 Aug 05 19:54:07.290275 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 246/486] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:07 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:07.700905 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:07.701443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:07.708164 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:07.708651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:07.709807 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:07.710836 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:07.711290 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:07.711717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:07.848549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:07.856513 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-34a7f4e1-ca09-4ee3-a0e0-d2f7f5e0f034 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.159670 Aug 05 19:54:07.857092 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 241/487] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:07 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:07.880054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:07.880689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:07.888756 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:07.889234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:07.889663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:07.890355 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:07.890836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:07.891256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:08.036589 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:08.045093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-554e44a0-4546-4114-a1a3-fd98f5f9c3b1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1681 microversion: 2.1 time: 0.169080 Aug 05 19:54:08.045673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 247/488] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:07 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:08.310178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:08.310822 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:08.317078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:08.317571 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:08.318009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:08.319878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:08.320008 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:08.320427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:08.462639 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:08.470342 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2a5dc40d-a7d8-473d-b29e-0e0b85b37a61 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1318 microversion: 2.1 time: 0.164069 Aug 05 19:54:08.470971 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 242/489] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:08 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:08.878479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:08.879115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:08.887124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:08.887804 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:08.888404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:08.888747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:08.889195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:08.889613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:09.034614 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:09.042470 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-986db176-b89a-4dbc-a5f7-d72f618f8623 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.167934 Aug 05 19:54:09.043085 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 248/490] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:08 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:09.067602 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:09.068231 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:09.075588 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:09.076084 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:09.076531 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:09.077245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:09.077704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:09.078137 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:09.294744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:09.303801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e4c7cde9-b67a-49a6-99cc-42c96c1bd9e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1681 microversion: 2.1 time: 0.239355 Aug 05 19:54:09.305095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 243/491] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:09 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:09.477722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-4b13a26d-8c0a-4f41-8398-f96177f4e76b req-af33e80b-9e25-4e56-9895-745def10fb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81773ee2-5bed-4fab-919c-792a6a2878cf", "name": "network-vif-plugged", "status": "completed", "tag": "1a1c1f16-2915-4829-ae7b-b060500e16cd"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:09.489922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-4b13a26d-8c0a-4f41-8398-f96177f4e76b req-af33e80b-9e25-4e56-9895-745def10fb33 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:09.490711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-4b13a26d-8c0a-4f41-8398-f96177f4e76b req-af33e80b-9e25-4e56-9895-745def10fb33 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:09.491135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:09.491561 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-4b13a26d-8c0a-4f41-8398-f96177f4e76b req-af33e80b-9e25-4e56-9895-745def10fb33 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:09.491876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:09.505658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:09.505658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:09.505658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:09.505658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:09.506316 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:09.506316 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:09.510596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-4b13a26d-8c0a-4f41-8398-f96177f4e76b req-af33e80b-9e25-4e56-9895-745def10fb33 service nova] Creating event network-vif-plugged:1a1c1f16-2915-4829-ae7b-b060500e16cd for instance 81773ee2-5bed-4fab-919c-792a6a2878cf on hv-cinder-85220 Aug 05 19:54:09.515957 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-4b13a26d-8c0a-4f41-8398-f96177f4e76b req-af33e80b-9e25-4e56-9895-745def10fb33 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043703 Aug 05 19:54:09.517371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 249/492] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:09.727205 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:09.735458 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8eda7a53-2b47-44da-8484-64fca4f99f8b tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1318 microversion: 2.1 time: 0.248311 Aug 05 19:54:09.736141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 244/493] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:09 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:10.066524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:10.067303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:10.074004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.074528 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.074992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.075707 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.076167 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.076595 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.219856 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:10.229198 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6e54c022-f61d-447b-bbfc-7d30ab2aa3fb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.167335 Aug 05 19:54:10.229704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 250/494] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:10 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:10.325374 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:10.326036 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:10.332627 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.333208 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.333649 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.335129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.335555 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.335983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.483556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:10.485421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:10.492744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.493249 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.493695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.494408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.495423 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.495867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.523453 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lazy-loading 'flavor' on Instance uuid e75eabf8-c187-4e38-afe7-c8f017f3a3f3 {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:10.649036 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:10.657271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6b26a7aa-fd91-475a-b5ce-93ab080a40dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1681 microversion: 2.1 time: 0.335730 Aug 05 19:54:10.670973 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 245/495] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:10 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1681 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:10.681748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d180aa5b-f6c7-4ce3-8ce0-4b250d2ceba5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/action" status: 200 len: 32 microversion: 2.1 time: 0.202682 Aug 05 19:54:10.682362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 251/496] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:54:10 2022] POST /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:54:10.691809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:10.692431 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:10.699554 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.700124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.700124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.700124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.702351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.702500 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.758331 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:10.758969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:10.765487 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.765973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.766607 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:10.768414 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:10.768414 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:10.768414 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:11.003749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:11.014520 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:11.016412 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2c163670-2d6b-425a-99ec-1ca2096b4cf6 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1318 microversion: 2.1 time: 0.263042 Aug 05 19:54:11.017020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 252/497] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:10 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:11.030427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6292920b-0960-4394-a08f-afbbca280cc3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.339791 Aug 05 19:54:11.030427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 246/498] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:10 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:11.252696 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:11.253411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:11.261605 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:11.262344 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:11.262985 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:11.263853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:11.264467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:11.265050 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:11.405087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-30f90c38-c975-4245-b456-7cabfdd95b78 req-41e4b053-d953-4d63-8d1e-8dbd4ce4af36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072224de-6d26-42c6-8b85-d68219c9cd8e", "name": "network-vif-deleted", "tag": "8102aa30-e00e-4595-a116-c8fc0b7138a1"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:11.415990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-30f90c38-c975-4245-b456-7cabfdd95b78 req-41e4b053-d953-4d63-8d1e-8dbd4ce4af36 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:11.416901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-30f90c38-c975-4245-b456-7cabfdd95b78 req-41e4b053-d953-4d63-8d1e-8dbd4ce4af36 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:11.417346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-30f90c38-c975-4245-b456-7cabfdd95b78 req-41e4b053-d953-4d63-8d1e-8dbd4ce4af36 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:11.419672 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:11.429638 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-29518b0d-af29-4f22-96a9-1328b71430f9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.180898 Aug 05 19:54:11.430476 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 253/499] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:11 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:11.433304 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-30f90c38-c975-4245-b456-7cabfdd95b78 req-41e4b053-d953-4d63-8d1e-8dbd4ce4af36 service nova] Creating event network-vif-deleted:8102aa30-e00e-4595-a116-c8fc0b7138a1 for instance 072224de-6d26-42c6-8b85-d68219c9cd8e on hv-cinder-85220 Aug 05 19:54:11.441141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-30f90c38-c975-4245-b456-7cabfdd95b78 req-41e4b053-d953-4d63-8d1e-8dbd4ce4af36 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039724 Aug 05 19:54:11.441984 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 247/500] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:11.682238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:11.682990 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:11.689311 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:11.689806 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:11.690246 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:11.691093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:11.691584 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:11.692011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:11.807208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:11.815701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7804ee3c-0216-4697-af09-f2501c3f2e08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 200 len: 1614 microversion: 2.1 time: 0.138467 Aug 05 19:54:11.822826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 254/501] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:11 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 1614 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:12.040806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:12.041848 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:12.056944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:12.060300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:12.075970 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.076476 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.076922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.077652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.078112 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.078542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.080620 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.081400 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.082370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.083712 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.085280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.086240 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.275396 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:12.277390 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:12.286129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fef5bf24-0a6b-4f78-b76c-1ce6420559a8 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1507 microversion: 2.1 time: 0.251786 Aug 05 19:54:12.296670 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dcb4616c-5816-4a8c-a300-7321c2f9fc83 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.249687 Aug 05 19:54:12.297948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 255/502] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:12 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:12.326083 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 248/503] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:12 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:12.331518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a40fd40e-029c-43b8-a376-6255ecdf3766", "device": "/dev/sdb"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:12.336874 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:12.343331 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.344054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.344774 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.345629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.346160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.347288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.454860 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:12.457802 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:12.468645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:12.470855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=6 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:12.473439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.476567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.477364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.478523 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.479233 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.479908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.595311 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:12.713573 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:12.730265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:12.744302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e63c1b4a-6c2e-493f-9fcd-7fb152f6a538 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "POST /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417902 Aug 05 19:54:12.745491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 256/504] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:54:12 2022] POST /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:54:12.745713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fff03239-5e95-4b77-b4c7-da7e80211a17 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.297464 Aug 05 19:54:12.746587 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 249/505] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:12 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:12.844500 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:12.845666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:12.852944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.853468 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.853799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.855541 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:12.856423 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:12.857073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:12.874869 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e HTTP/1.1 Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:54:12.877222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:54:12.878494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '072224de-6d26-42c6-8b85-d68219c9cd8e'} Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:54:12.879245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:54:12.880380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:12.884051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:54:12.885217 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8d06cf08-f9c9-458a-b8e0-15c0721e7bca tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 404 len: 111 microversion: 2.1 time: 0.045023 Aug 05 19:54:12.890038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 257/506] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:12 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:54:12.896163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ab2d9347-1732-43e6-aac8-b3a4a6b4eeae tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '.version_select at 0x7f18c8112b80>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:12.921892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ab2d9347-1732-43e6-aac8-b3a4a6b4eeae tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683447362" status: 202 len: 0 microversion: 2.1 time: 0.030288 Aug 05 19:54:12.926712 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 250/507] 10.222.0.86 () {58 vars in 1221 bytes} [Fri Aug 5 19:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683447362 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:54:13.331706 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:13.332732 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:13.339670 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:13.341235 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:13.341904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:13.343004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:13.343669 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:13.344572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:13.512093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:13.525052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9d5d748b-ba2f-4d67-993a-90c5569591b6 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.197093 Aug 05 19:54:13.525873 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 258/508] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:13 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:13.765924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:13.766472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:13.767039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:13.767644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:13.775363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:13.775831 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:13.776263 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:13.777033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:13.777398 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:13.778081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:13.779860 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:13.780764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:13.781717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:13.783464 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:13.784269 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:13.785223 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:13.911341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lazy-loading 'services' on Instance uuid 0f41d629-ef18-4686-bf58-6b13e25fe71d {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:13.957245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:13.966443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d316cd6e-d4c4-4162-92af-888b87b9c3ec tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1679 microversion: 2.1 time: 0.202723 Aug 05 19:54:13.967459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 259/509] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:13 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:13.999757 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-11c55148-ee69-4af8-80d3-fa771330a2b9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments/90ab3fa6-9619-4d7b-acf6-a635b31113af" status: 202 len: 0 microversion: 2.1 time: 0.238067 Aug 05 19:54:14.000367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 251/510] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:54:13 2022] DELETE /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments/90ab3fa6-9619-4d7b-acf6-a635b31113af => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:54:14.009862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:14.012292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:14.019025 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:14.019526 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:14.019966 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:14.020682 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:14.021141 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:14.021602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:14.067214 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e15997b7-f17d-4b9e-a0da-611a314f21c2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062084 Aug 05 19:54:14.067873 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 260/511] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:54:14 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:14.547680 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:14.548375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:14.555892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:14.556507 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:14.556874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:14.557576 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:14.558029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:14.558480 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:14.695021 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:14.703216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-74b2ab59-5133-432f-a570-290e3cd2b24d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.159738 Aug 05 19:54:14.703789 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 252/512] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:14 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:14.989470 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:14.990452 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:14.996872 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:14.997360 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:14.997803 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:14.998518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:14.999000 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:14.999434 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:15.081637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:15.084874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:15.087616 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:15.093326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:15.093985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:15.094412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:15.095152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:15.095605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:15.096034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:15.129633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-eefdb2c3-11e0-462f-a2f3-84298df3676e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051920 Aug 05 19:54:15.130416 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 253/513] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:54:15 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:54:15.143187 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:15.153337 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d66c5c39-dd06-4d67-acbb-3b65fd21dfd0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1656 microversion: 2.1 time: 0.166934 Aug 05 19:54:15.153337 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 261/514] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:14 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1656 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:15.176028 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fc081fc6-c82c-4a3b-b677-ebc91813d6ac tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:15.182475 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc081fc6-c82c-4a3b-b677-ebc91813d6ac tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:15.182999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc081fc6-c82c-4a3b-b677-ebc91813d6ac tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:15.183443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc081fc6-c82c-4a3b-b677-ebc91813d6ac tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:15.206385 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fc081fc6-c82c-4a3b-b677-ebc91813d6ac tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Going to try to start instance {{(pid=124552) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 19:54:15.256106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fc081fc6-c82c-4a3b-b677-ebc91813d6ac tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/action" status: 202 len: 0 microversion: 2.1 time: 0.083561 Aug 05 19:54:15.257216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 254/515] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:54:15 2022] POST /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:54:15.265474 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:15.266174 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:15.273043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:15.273603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:15.274043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:15.274854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:15.275306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:15.275727 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:15.454502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:15.464127 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-eaf05c70-a997-44a3-9f68-099e1fd075aa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1665 microversion: 2.1 time: 0.202411 Aug 05 19:54:15.464909 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 262/516] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:15 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1665 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:15.726540 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:15.727283 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:15.733601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:15.734088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:15.734532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:15.735266 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:15.735728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:15.736161 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:15.877552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:15.879957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:15.887271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-04dc803a-1e56-4a7a-9ecb-33f6e7b10718 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.165571 Aug 05 19:54:15.887869 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 255/517] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:15 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:16.142959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:16.145158 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:16.152365 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.152857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.153301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.155259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.155259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.155259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.188995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c2e18f6f-bfe5-497b-b19f-c7a3a3aff793 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050073 Aug 05 19:54:16.189884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 263/518] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:54:16 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:16.485511 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:16.486149 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:16.494112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.494604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.495098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.495766 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.496222 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.496645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.634440 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:16.642108 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-614f5a0f-b579-4252-a135-700759f824ef tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1665 microversion: 2.1 time: 0.160528 Aug 05 19:54:16.642696 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 256/519] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:16 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:16.908630 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:16.909238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:16.916787 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.917276 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.917717 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.918420 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.918901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.919329 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:17.065088 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:17.073744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dbee2cc1-c954-4dc3-995d-b99e70c3c0be tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.168912 Aug 05 19:54:17.074442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 264/520] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:16 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:17.203588 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:17.205825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:17.214346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:17.214876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:17.215317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:17.216021 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:17.216472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:17.216903 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:17.248331 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-170126dc-e8fa-4b21-a52d-e279c457bd15 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050540 Aug 05 19:54:17.248907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 257/521] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:54:17 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:17.666189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:17.666828 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:17.669292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:17.674790 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:17.675302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:17.675733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:17.676431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:17.676877 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:17.677800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:17.814969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:17.823186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-282e9882-23d3-4a08-9de8-688744bf2a05 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1669 microversion: 2.1 time: 0.161307 Aug 05 19:54:17.823770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 265/522] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:17 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:18.104176 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:18.104832 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:18.111453 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:18.111938 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:18.112375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:18.113065 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:18.113519 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:18.113944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:18.255085 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:18.261822 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:18.263996 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:18.264187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7cbffbde-946a-463b-a84a-7ad571069090 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.164881 Aug 05 19:54:18.264772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 258/523] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:18 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:18.270094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:18.270584 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:18.271069 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:18.272724 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:18.273184 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:18.273611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:18.308712 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3f9f93cf-860b-478e-b85e-a6bf66cca3e0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050746 Aug 05 19:54:18.309342 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 266/524] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:54:18 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:54:19.285487 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:19.286140 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:19.293053 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:19.293534 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:19.293969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:19.294684 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:19.295143 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:19.295564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:19.321907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:19.324250 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:19.331241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:19.331889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:19.332336 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:19.333049 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:19.333568 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:19.334003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:19.366999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0134539f-c6b1-4691-a116-28f0579d6dd8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049863 Aug 05 19:54:19.368862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 267/525] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:54:19 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:54:19.438592 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:19.449634 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e0737a6c-c201-4b28-8fdd-10782a8d2762 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.167784 Aug 05 19:54:19.450595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 259/526] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:19 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:20.383744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:20.386958 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:20.399230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:20.400656 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:20.401615 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:20.402798 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:20.403433 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:20.404129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:20.460339 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c4b34163-d796-40bc-b176-72df336f706b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083385 Aug 05 19:54:20.475311 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 268/527] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:54:20 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:20.477490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:20.478829 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:20.489902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:20.490402 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:20.491235 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:20.492428 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:20.493037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:20.493568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:20.639165 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:20.647488 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-31afd9ce-f538-4282-b7fc-56e14f9c2028 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.177597 Aug 05 19:54:20.648073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 260/528] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:20 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:21.477006 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:21.479286 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:21.486234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:21.486759 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:21.487198 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:21.487907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:21.488360 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:21.488782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:21.525956 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-aea5c806-57f2-48a6-a5e4-8bd8e40ae498 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053861 Aug 05 19:54:21.526546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 269/529] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:54:21 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:54:21.593624 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:21.594189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:21.601557 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:21.602053 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:21.602494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:21.603234 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:21.603695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:21.604128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:21.632929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:54:21.669023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:21.669630 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:21.676336 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:21.676834 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:21.677342 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:21.678242 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:21.679015 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:21.679617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:21.718686 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e7b4d98e-4641-45eb-a69c-48f7a7c8c834 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 204 len: 0 microversion: 2.1 time: 0.128561 Aug 05 19:54:21.719290 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 261/530] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:54:21 2022] DELETE /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:54:21.728791 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:21.729398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:21.736081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:21.736578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:21.737023 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:21.737743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:21.738201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:21.738767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:21.846853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:21.858244 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-41637628-5237-46c5-9655-0125f5db1ead tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.193037 Aug 05 19:54:21.858874 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 270/531] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:21 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:21.888157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:21.896636 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fb70be1c-f634-4c00-8a48-acaa5b0adb27 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1680 microversion: 2.1 time: 0.171937 Aug 05 19:54:21.897361 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 262/532] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:21 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:22.880769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:22.881751 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:22.888263 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:22.888755 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:22.889197 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:22.889909 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:22.890368 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:22.890910 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:22.924327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:22.924951 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:22.932825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:22.933326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:22.933768 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:22.934515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:22.934971 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:22.935527 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:23.034450 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:23.043155 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b4734bbe-11cf-4bf7-b0cf-d646a2dfc922 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.166229 Aug 05 19:54:23.043977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 271/533] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:22 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:23.073831 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:23.084152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9b39b43a-e0c4-4528-b31a-35abf438fa7a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1680 microversion: 2.1 time: 0.164078 Aug 05 19:54:23.084734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 263/534] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:22 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:24.076001 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:24.076533 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:24.083771 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:24.084956 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:24.085751 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:24.086870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:24.087423 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:24.087862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:24.107246 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:24.108103 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:24.114228 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:24.114747 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:24.115254 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:24.115958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:24.116410 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:24.116967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:24.236787 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:24.246129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-91a2812e-301b-4356-bb25-6641277f9da2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.174320 Aug 05 19:54:24.246763 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 272/535] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:24 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:24.270112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:24.279059 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-246afb35-577f-402b-bc6b-8d63c6dc48fd tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1680 microversion: 2.1 time: 0.176772 Aug 05 19:54:24.279638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 264/536] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:24 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:25.266926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:25.267545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:25.274431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:25.274964 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:25.275397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:25.276090 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:25.276538 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:25.276957 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:25.301075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:25.301691 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:25.309165 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:25.309650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:25.310088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:25.310821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:25.311272 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:25.311695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:25.434387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:25.436632 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:25.444230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-bebbdc87-6f61-421a-bfa8-5d65a9ce9b76 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.181062 Aug 05 19:54:25.444829 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 273/537] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:25 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:25.450139 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:25.458142 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e6f1f64b-641d-4cba-b168-c0f80b1d4423 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1680 microversion: 2.1 time: 0.160960 Aug 05 19:54:25.458762 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 265/538] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:25 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:26.466212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:26.466867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:26.476960 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:26.477484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:26.478091 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:26.478827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:26.479282 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:26.479733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:26.480675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:26.481311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:26.488326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:26.488894 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:26.489260 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:26.489967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:26.490429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:26.490883 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:26.623071 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:26.631470 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9294ac1b-c84a-40f1-8e42-f6ea2900a73d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.169537 Aug 05 19:54:26.632067 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 274/539] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:26 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:26.640208 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:26.645420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8569cfc6-2215-47fa-ad7b-2583a486ad30 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1680 microversion: 2.1 time: 0.169314 Aug 05 19:54:26.646213 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 266/540] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:26 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:27.653851 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:27.654474 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:27.661176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:27.661666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:27.662100 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:27.662831 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:27.663285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:27.663710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:27.667035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:27.667664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:27.673952 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:27.674482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:27.678439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:27.678439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:27.678439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:27.678439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:27.814909 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:27.823635 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-69da5bf9-1e6e-4b8b-aa80-37c05cb1b186 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.173615 Aug 05 19:54:27.824230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 275/541] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:27 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:27.826437 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:27.834831 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-774809ec-3e17-40e7-904e-dcc146a0b49a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1680 microversion: 2.1 time: 0.171742 Aug 05 19:54:27.835406 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 267/542] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:27 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:28.845196 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:28.845807 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:28.853649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:28.854157 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:28.854607 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:28.855412 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:28.855872 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:28.856302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:28.858781 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:28.859514 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:28.866028 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:28.866524 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:28.867004 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:28.867715 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:28.868801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:28.869230 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:29.017826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:29.032558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7760aee6-83e5-4c38-8cb0-51c86577ce09 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.191486 Aug 05 19:54:29.033249 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 276/543] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:28 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:29.033735 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:29.042660 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9ee5b2a3-b551-4e67-bd7e-356b88183884 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1680 microversion: 2.1 time: 0.188466 Aug 05 19:54:29.043224 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 268/544] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:28 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:30.055087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:30.056571 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:30.067570 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.067570 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.067570 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.068631 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:30.069117 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.069212 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:30.069297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.069297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.073443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.074024 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.074617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.075513 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.075979 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.076408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.291034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:30.302969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-af417dfe-6340-40cb-8480-14335d26b983 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1680 microversion: 2.1 time: 0.241585 Aug 05 19:54:30.319034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 269/545] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:30 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:30.319034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:30.319034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:30.319034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.319516 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.319516 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.319516 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.319833 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.320124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.347074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:30.349945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:30.356142 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4902d3e9-be23-49a9-bdec-5c350801346b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments/9bd6e06e-1571-4bb6-b8cb-a3a1c6a545ac" status: 200 len: 194 microversion: 2.20 time: 0.051149 Aug 05 19:54:30.356966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 270/546] 10.222.0.86 () {60 vars in 1454 bytes} [Fri Aug 5 19:54:30 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments/9bd6e06e-1571-4bb6-b8cb-a3a1c6a545ac => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:54:30.358867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e3b43522-b04f-4cee-87cf-347eed9aa038 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.307754 Aug 05 19:54:30.359924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 277/547] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:30 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:30.439821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:30.440322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:30.447445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.447926 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.448366 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.449083 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.449543 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.449977 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.538215 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lazy-loading 'services' on Instance uuid 096fbbf4-4d8a-4e2a-aa55-118994138c19 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:30.616683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0bb5a493-6532-48c4-9a33-c8cbe7ef60f2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "DELETE /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments/9bd6e06e-1571-4bb6-b8cb-a3a1c6a545ac" status: 202 len: 0 microversion: 2.20 time: 0.181473 Aug 05 19:54:30.617281 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 271/548] 10.222.0.86 () {60 vars in 1457 bytes} [Fri Aug 5 19:54:30 2022] DELETE /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments/9bd6e06e-1571-4bb6-b8cb-a3a1c6a545ac => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:54:30.626704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:30.629010 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:30.637898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.638608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.639090 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.639840 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:30.640466 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:30.641067 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:30.673694 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a00fbe2b-ed54-4d78-9992-302e5c8d3b6c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051104 Aug 05 19:54:30.674291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 278/549] 10.222.0.86 () {60 vars in 1343 bytes} [Fri Aug 5 19:54:30 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:54:31.129476 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-8c588f9d-c2ef-4f9a-bd31-24ee49e25bb3 req-0cc983e2-052d-40c7-b23f-501051ed34c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f41d629-ef18-4686-bf58-6b13e25fe71d", "name": "network-vif-deleted", "tag": "64a76b31-851d-4d9e-a758-2332f4882ab7"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:31.151071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-8c588f9d-c2ef-4f9a-bd31-24ee49e25bb3 req-0cc983e2-052d-40c7-b23f-501051ed34c7 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:31.151684 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-8c588f9d-c2ef-4f9a-bd31-24ee49e25bb3 req-0cc983e2-052d-40c7-b23f-501051ed34c7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:31.152477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-8c588f9d-c2ef-4f9a-bd31-24ee49e25bb3 req-0cc983e2-052d-40c7-b23f-501051ed34c7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:31.166151 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-8c588f9d-c2ef-4f9a-bd31-24ee49e25bb3 req-0cc983e2-052d-40c7-b23f-501051ed34c7 service nova] Creating event network-vif-deleted:64a76b31-851d-4d9e-a758-2332f4882ab7 for instance 0f41d629-ef18-4686-bf58-6b13e25fe71d on hv-cinder-85220 Aug 05 19:54:31.171807 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-8c588f9d-c2ef-4f9a-bd31-24ee49e25bb3 req-0cc983e2-052d-40c7-b23f-501051ed34c7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047591 Aug 05 19:54:31.173675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 272/550] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:31.327322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:31.328630 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:31.340908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:31.341769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:31.342404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:31.343405 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:31.344067 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:31.344677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:31.383421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:31.385224 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:31.392372 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:31.393238 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:31.394185 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:31.395188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:31.395909 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:31.396562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:31.418277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:31.428528 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-decc4a1d-1b5b-4177-ad02-fe0514f57e21 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1613 microversion: 2.1 time: 0.105344 Aug 05 19:54:31.430329 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 279/551] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:31 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1613 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:31.567679 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:31.578477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9555ebd7-a894-41f4-93ad-b5d63a8102c5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1737 microversion: 2.1 time: 0.199152 Aug 05 19:54:31.579038 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 273/552] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:31 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:31.688187 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:31.690513 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:31.697643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:31.698124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:31.698583 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:31.699312 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:31.699769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:31.700200 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:31.733429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b054916a-85b1-4cdc-9bbe-61f47b790394 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049616 Aug 05 19:54:31.734016 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 280/553] 10.222.0.86 () {60 vars in 1343 bytes} [Fri Aug 5 19:54:31 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:54:32.347954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:32.348549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:32.359130 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.359723 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.360155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.361024 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.361976 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.362417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.451894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:32.452508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:32.454393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lazy-loading 'services' on Instance uuid 81773ee2-5bed-4fab-919c-792a6a2878cf {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:32.459132 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.459617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.460044 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.460742 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.461198 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.461603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.501283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.501804 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.502336 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.502833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lazy-loading 'fault' on Instance uuid 0f41d629-ef18-4686-bf58-6b13e25fe71d {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:32.536173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2ff7769e-fbe7-464f-83e2-ef96a6ff9378 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "DELETE /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf/os-volume_attachments/a40fd40e-029c-43b8-a376-6255ecdf3766" status: 202 len: 0 microversion: 2.1 time: 0.193055 Aug 05 19:54:32.536879 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 274/554] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:54:32 2022] DELETE /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf/os-volume_attachments/a40fd40e-029c-43b8-a376-6255ecdf3766 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:54:32.552299 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:32.563978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c3a1e357-70ae-439f-b637-fdb568a697b2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1331 microversion: 2.1 time: 0.115750 Aug 05 19:54:32.564627 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 281/555] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:32 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:32.602548 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:32.603308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:32.610272 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.610808 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.611240 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.611940 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.612396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.612818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.750111 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:32.752307 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:32.758339 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.758978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.759525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.760252 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.760695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.761122 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.763081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:32.771418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-eedf9e32-743b-4bdd-81c8-5a749e9ce14d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1717 microversion: 2.1 time: 0.173681 Aug 05 19:54:32.771996 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 275/556] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:32 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:32.792396 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7c73dd87-af4c-4a5b-9293-4520113fcfea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046327 Aug 05 19:54:32.792967 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 282/557] 10.222.0.86 () {60 vars in 1343 bytes} [Fri Aug 5 19:54:32 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:32.861137 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:32.861633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:32.870400 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.871212 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.871644 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.872529 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.874781 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.875487 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.890668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:32.892920 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:32.897226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.897712 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.898144 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.899421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:32.899877 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:32.900306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:32.902075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:54:32.996559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-59d69d43-8dc8-4bb3-8d35-818e97157181 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "DELETE /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 204 len: 0 microversion: 2.20 time: 0.139145 Aug 05 19:54:32.997177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 276/558] 10.222.0.86 () {60 vars in 1280 bytes} [Fri Aug 5 19:54:32 2022] DELETE /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 19:54:33.007268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:33.008043 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:33.015280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.015889 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.016851 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.017778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.018241 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.018872 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.064296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] HTTP exception thrown: Cannot 'detach_volume' instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 while it is in vm_state rescued Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Request method failure captured: Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments/f1814c80-35c1-487f-9219-8524f85f778d HTTP/1.1 Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRoBp7v2JhjAzgVq1cWsYiA0mH9TZlZoUjqM4s3bbCY4VzEGYMq8T6pPBvK77eXO7ywOgkhRmCAZgAIFq7kt4N1tU6o_U5KnIjXcbPNn0aeYnrrGb5UNkx50nMwoJoHd4BAsufzPPDT2agJBFtcA6nesUSm5FI09tcwFD4V2eRvHLA Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:54:33.065794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}] Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: d183fcdae86448caa81c09823dd3884e Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:54:33.067439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Cannot 'detach_volume' instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 while it is in vm_state rescued Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'server_id': 'e75eabf8-c187-4e38-afe7-c8f017f3a3f3', 'id': 'f1814c80-35c1-487f-9219-8524f85f778d'} Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:54:33.068272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 while it is in vm_state rescued Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 while it is in vm_state rescued Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:54:33.069901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Returning 409 to user: Cannot 'detach_volume' instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 while it is in vm_state rescued {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:54:33.071153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b23ba672-8262-4433-9202-9c33e4cbbc46 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "DELETE /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments/f1814c80-35c1-487f-9219-8524f85f778d" status: 409 len: 152 microversion: 2.1 time: 0.180645 Aug 05 19:54:33.071153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 283/559] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:54:32 2022] DELETE /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments/f1814c80-35c1-487f-9219-8524f85f778d => generated 152 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 05 19:54:33.080957 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:33.081511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:33.089749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.090287 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.090765 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.091487 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.091950 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.092380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.176002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-62db165e-19b3-4157-9d61-987a0e2d3a0b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "POST /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/action" status: 202 len: 0 microversion: 2.1 time: 0.101826 Aug 05 19:54:33.177053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 284/560] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:54:33 2022] POST /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 19:54:33.187634 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:33.188712 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:33.196133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:33.196374 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.196755 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.197201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.197922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.198387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.198880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.205102 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:33.206514 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:33.207743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3f331e0a-99bd-4686-9250-e31a24a85be7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.205351 Aug 05 19:54:33.208559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 277/561] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:33 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:33.345199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:33.356802 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-17a4dc09-d0f9-4914-8b9d-c9e689c44cbd tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1725 microversion: 2.1 time: 0.175175 Aug 05 19:54:33.357607 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 285/562] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:33 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:33.585538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:33.586090 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:33.593446 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.593959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.594402 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.595136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.595592 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.596018 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.630784 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:33.631455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:33.631998 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:33.632471 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lazy-loading 'fault' on Instance uuid 0f41d629-ef18-4686-bf58-6b13e25fe71d {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:33.679450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:33.687944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-991f08b5-d7fb-4856-9bfd-1840cc9ded83 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1331 microversion: 2.1 time: 0.106322 Aug 05 19:54:33.688529 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 278/563] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:33 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:34.233304 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:34.233899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:34.240593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:34.241137 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:34.241523 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:34.242221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:34.242802 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:34.243226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:34.383087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:34.384317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:34.390111 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:34.394842 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:34.395687 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:34.396459 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:34.397639 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:34.398414 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:34.399644 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:34.401154 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:34.402665 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:34.404019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a6df7e99-474c-44df-aac9-87c3147ed95d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.174609 Aug 05 19:54:34.404396 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 286/564] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:34 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:54:34.544675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:34.556988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-72c3294d-eb3e-45f7-87b5-523bc2ed3674 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1725 microversion: 2.1 time: 0.180979 Aug 05 19:54:34.557574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 279/565] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:34 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:34.710303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:34.710938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:34.722048 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:34.722553 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:34.723552 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:34.723736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:34.724547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:34.724970 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:34.779202 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:34.779838 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:34.780294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:34.780753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lazy-loading 'fault' on Instance uuid 0f41d629-ef18-4686-bf58-6b13e25fe71d {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:34.849599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:34.857791 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3a1b335e-7e87-41bd-af8b-2ebbe8249c93 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 200 len: 1331 microversion: 2.1 time: 0.151684 Aug 05 19:54:34.858400 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 287/566] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:34 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:35.430668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:35.432144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:35.439601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:35.440112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:35.440554 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:35.441261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:35.441716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:35.442139 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:35.577975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:35.578585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:35.585882 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:35.588168 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:35.588654 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:35.589451 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:35.589993 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:35.590482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:35.711668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:35.721732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:35.724283 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:35.725535 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c1680a9a-22df-418f-8294-e422da5b3bec tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1724 microversion: 2.20 time: 0.300562 Aug 05 19:54:35.729327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 280/567] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:35 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:35.824954 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:35.827717 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:35.849882 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b350fb49-337a-4c3f-b3c8-1bca7a7c8ba0 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1725 microversion: 2.1 time: 0.275264 Aug 05 19:54:35.851074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 288/568] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:35 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:35.879943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:35.880562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:35.890857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:35.891645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:35.893198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:35.894672 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:35.895328 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:35.895930 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:35.919097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d HTTP/1.1 Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:54:35.922308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:54:35.924044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '0f41d629-ef18-4686-bf58-6b13e25fe71d'} Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:54:35.925112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:54:35.927892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:35.929438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:54:35.929438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3d20fbc8-7a6b-491d-bc18-380911ca7cfe tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 404 len: 111 microversion: 2.1 time: 0.047795 Aug 05 19:54:35.929438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 281/569] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:35 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:54:35.933550 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1f9f4bf2-d31d-400b-890f-14f12c390c1a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '.version_select at 0x7f18c80a2b80>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:35.966526 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1f9f4bf2-d31d-400b-890f-14f12c390c1a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631433874" status: 202 len: 0 microversion: 2.1 time: 0.037043 Aug 05 19:54:35.968886 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 289/570] 10.222.0.86 () {58 vars in 1221 bytes} [Fri Aug 5 19:54:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631433874 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:54:36.630957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-989c1c89-249a-4195-a670-c536ba6f8fd9 req-349dbacb-21a1-49c2-a9ff-6534045c45b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096fbbf4-4d8a-4e2a-aa55-118994138c19", "name": "network-vif-deleted", "tag": "22eda304-25c6-40ca-ba58-e4b19b0a7687"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:36.646551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-989c1c89-249a-4195-a670-c536ba6f8fd9 req-349dbacb-21a1-49c2-a9ff-6534045c45b7 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:36.647086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-989c1c89-249a-4195-a670-c536ba6f8fd9 req-349dbacb-21a1-49c2-a9ff-6534045c45b7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:36.647520 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-989c1c89-249a-4195-a670-c536ba6f8fd9 req-349dbacb-21a1-49c2-a9ff-6534045c45b7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:36.660952 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-989c1c89-249a-4195-a670-c536ba6f8fd9 req-349dbacb-21a1-49c2-a9ff-6534045c45b7 service nova] Creating event network-vif-deleted:22eda304-25c6-40ca-ba58-e4b19b0a7687 for instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 on hv-cinder-85220 Aug 05 19:54:36.671177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-989c1c89-249a-4195-a670-c536ba6f8fd9 req-349dbacb-21a1-49c2-a9ff-6534045c45b7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044375 Aug 05 19:54:36.672601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 282/571] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:36.756096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:36.757542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:36.768239 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:36.769769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:36.771101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:36.773626 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:36.775751 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:36.776823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:36.839636 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-333b5218-78ac-421e-be8a-f9d7e9dd6068 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: .version_select at 0x7f18c8134430>, body: {"keypair": {"name": "tempest-keypair-747806953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1yjpiZxlLIe0VAmFSX14wj5WBG5+JWsvcaHqT4Ib+vGfodaqgel5mVjdlmlP7m36Off0LOUCWv45q8hQbFbg9/mTXXFazCKUCBadjhHcCIIVELDaBJkEGLPtt9UMFOxg=="}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:36.861460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-333b5218-78ac-421e-be8a-f9d7e9dd6068 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:54:36.866358 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-333b5218-78ac-421e-be8a-f9d7e9dd6068 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for user a357a3d27e4e41adae1c56ee39ae5aa7 and project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:54:36.903580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-333b5218-78ac-421e-be8a-f9d7e9dd6068 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067998 Aug 05 19:54:36.904898 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 283/572] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:54:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:54:36.911422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:36.912168 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:36.924394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:36.925215 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:36.925868 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:36.926997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:36.927618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:36.928222 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:36.933578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:36.944274 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:36.946019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:36.948030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4e8fb0df-071a-430e-ae3b-b78d57e98fb6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1656 microversion: 2.20 time: 0.197102 Aug 05 19:54:36.948605 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 290/573] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:36 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1656 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:36.953460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:36.954838 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:36.968164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:36.968757 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:36.969206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:36.969978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:36.970706 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:36.971291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:37.005621 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Going to try to terminate instance {{(pid=124553) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:54:37.136849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3b063642-526d-4351-9c13-799e57341ff0 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "DELETE /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 204 len: 0 microversion: 2.1 time: 0.186769 Aug 05 19:54:37.140900 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 291/574] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:54:36 2022] DELETE /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:54:37.147051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:37.147758 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:37.155286 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:37.155800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:37.156518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:37.157652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:37.158435 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:37.159839 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:37.342325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:37.353084 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e3795620-ed31-4491-90e7-dc037909ab6f tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1513 microversion: 2.1 time: 0.210464 Aug 05 19:54:37.354718 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 292/575] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:37 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:37.399604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:37.409814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-24dc186f-f851-40e9-a221-7dfc004220f9 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1725 microversion: 2.1 time: 0.503323 Aug 05 19:54:37.410652 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 284/576] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:36 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1725 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:37.972867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:37.973547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:37.982175 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:37.983478 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:37.984104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:37.985661 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:37.986307 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:37.986912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:38.070399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:38.082467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:38.084023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:38.085173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3be60bcc-4994-46fe-827b-c34db00341e3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1366 microversion: 2.20 time: 0.116368 Aug 05 19:54:38.085745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 293/577] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:37 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:38.375434 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:38.376059 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:38.382825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:38.383485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:38.383933 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:38.384652 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:38.385115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:38.385546 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:38.433145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:38.433788 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:38.440048 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:38.440535 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:38.440971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:38.441676 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:38.442744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:38.442744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:38.820099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:38.830222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f61b2ca2-a7f7-487a-9687-3d860ca1bd28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1725 microversion: 2.1 time: 0.402230 Aug 05 19:54:38.831083 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 294/578] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:38 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1725 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:38.845838 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:38.855883 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-df507a82-7dd6-4a08-b2f7-144e009e2237 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1513 microversion: 2.1 time: 0.483962 Aug 05 19:54:38.856559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 285/579] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:38 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1513 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:38.896793 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-834970037", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "959e8ab5-efdc-46d3-bf82-ceecf78a7830"}], "security_groups": [{"name": "tempest-securitygroup--301676074"}], "key_name": "tempest-keypair-747806953", "user_data": "}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:39.004343 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] validate_networks() for [('959e8ab5-efdc-46d3-bf82-ceecf78a7830', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:54:39.107282 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:39.107927 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:39.113929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:39.114462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:39.115039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:39.115716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:39.116174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:39.116605 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:39.187029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:39.195375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:39.197523 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:39.198687 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5d54c353-9a74-47a6-b7c9-f67fffdf1301 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1366 microversion: 2.20 time: 0.095447 Aug 05 19:54:39.199414 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 286/580] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:39 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:54:39.406429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:54:39.406882 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:54:39.407356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:54:39.407864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:54:39.408276 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:54:39.417054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:39.417533 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:39.417962 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:39.418711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:39.419165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:39.419586 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:39.437681 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:54:39.443912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for user a357a3d27e4e41adae1c56ee39ae5aa7 and project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:54:39.454584 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:54:39.456881 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:54:39.506873 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-591d49fd-e6bf-485e-ac92-f543a94f3b42 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.614386 Aug 05 19:54:39.507533 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 295/581] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:54:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 19:54:39.519640 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d8c975be-fae5-4430-89a6-c037adaea0c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:39.520257 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d8c975be-fae5-4430-89a6-c037adaea0c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:39.577193 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d8c975be-fae5-4430-89a6-c037adaea0c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:39.584536 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d8c975be-fae5-4430-89a6-c037adaea0c8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1240 microversion: 2.1 time: 0.069174 Aug 05 19:54:39.585106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 287/582] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:39 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:39.852143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:39.853299 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:39.860138 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:39.860633 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:39.861068 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:39.861969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:39.862505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:39.862880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:39.879294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:39.880038 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:39.887732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:39.888226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:39.888665 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:39.889367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:39.890651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:39.890651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:39.896031 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:40.058443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:40.068442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-071d6432-568f-4c80-b80b-9b586024a3ed tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1725 microversion: 2.1 time: 0.220912 Aug 05 19:54:40.069027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 296/583] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:39 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:40.088443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:40.098263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4c5dc318-a5ec-4461-92d7-7cad4e9d7aaa tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1513 microversion: 2.1 time: 0.223423 Aug 05 19:54:40.098899 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 288/584] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:39 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:40.223705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:40.224230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:40.231614 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:40.232110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:40.232591 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:40.233307 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:40.233767 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:40.234277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:40.267405 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:40.268250 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:40.268387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:40.268789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lazy-loading 'fault' on Instance uuid 096fbbf4-4d8a-4e2a-aa55-118994138c19 {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:40.313996 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:40.322338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:40.324195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:40.325400 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0cd8f76d-c155-4cc3-a202-43e2c90e2eed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 200 len: 1371 microversion: 2.20 time: 0.106174 Aug 05 19:54:40.326000 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 297/585] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:40 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:40.605639 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:40.606268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:40.613116 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:40.613629 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:40.614087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:40.614850 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:40.615312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:40.615752 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:40.686262 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:40.696468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-762dd9a6-7be4-4868-a8e4-a11202cbd0c1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1244 microversion: 2.1 time: 0.094337 Aug 05 19:54:40.697261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 289/586] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:40 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:41.091287 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:41.091913 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:41.099774 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.100283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.100950 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.101744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.102555 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.103018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.122707 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:41.123315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:41.125919 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:41.131018 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.131787 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.132380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.135544 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.136227 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.136816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.314868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:41.324064 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a5110d96-3290-4163-8cf4-66225283d20a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1731 microversion: 2.1 time: 0.236725 Aug 05 19:54:41.324649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 298/587] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:41 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:41.347681 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:41.348190 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:41.355162 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.355651 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.356083 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.356781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.357236 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.357656 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.429939 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:41.441677 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-50579dc1-6854-4b52-8892-ceecfdd95238 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1513 microversion: 2.1 time: 0.323275 Aug 05 19:54:41.442771 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 290/588] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:41 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:41.448845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:41.449644 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:41.451948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d61253a7-c959-42ff-bc39-36ce406b5516 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109060 Aug 05 19:54:41.462324 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 299/589] 10.222.0.86 () {58 vars in 1275 bytes} [Fri Aug 5 19:54:41 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:54:41.467553 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.468181 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.468728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.469521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.470226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.470700 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.488321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] HTTP exception thrown: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Request method failure captured: Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 HTTP/1.1 Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRh8A8i6Fh3JQOfW_QUavC-2gH1K1i44JdIYaNCprqW1UVgmvyIYiRbzVdRahxnPEVfpvRzXuatk7smRskh26JJUhKrJk_vjw1h7RHFEDgFlhIuY_STsQjN4NyTXyPrbr_YrRYWpR0QP45p5GlzggjGadVcxXVlOcakcAYlNL6AbBg Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:54:41.490109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}] Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: e8f7435928a74258af5478959bd939bb Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:54:41.491746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '096fbbf4-4d8a-4e2a-aa55-118994138c19'} Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:54:41.492681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:54:41.494093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:41.495690 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Returning 404 to user: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:54:41.495690 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9c0115b0-b552-4b87-97a2-2bde5cd49089 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 404 len: 111 microversion: 2.20 time: 0.048959 Aug 05 19:54:41.495690 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 291/590] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:41 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 19:54:41.505422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-da31bf50-8917-4b0d-b728-8c9a4a3d60cd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '.version_select at 0x7f18c8201a60>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:41.513460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:41.534456 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-da31bf50-8917-4b0d-b728-8c9a4a3d60cd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970463766" status: 204 len: 0 microversion: 2.20 time: 0.033966 Aug 05 19:54:41.535003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 300/591] 10.222.0.86 () {60 vars in 1259 bytes} [Fri Aug 5 19:54:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970463766 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 19:54:41.724737 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:41.728009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:41.735625 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-b88c123e-38d7-45d1-9fc4-ea8cfa067822 req-f064e90f-5d08-4653-9c8e-a54d10f0ce98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81773ee2-5bed-4fab-919c-792a6a2878cf", "name": "network-vif-deleted", "tag": "1a1c1f16-2915-4829-ae7b-b060500e16cd"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:41.745153 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.749192 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.750144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.752305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.755227 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.756433 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.767056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b88c123e-38d7-45d1-9fc4-ea8cfa067822 req-f064e90f-5d08-4653-9c8e-a54d10f0ce98 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:41.767936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b88c123e-38d7-45d1-9fc4-ea8cfa067822 req-f064e90f-5d08-4653-9c8e-a54d10f0ce98 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:41.768699 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b88c123e-38d7-45d1-9fc4-ea8cfa067822 req-f064e90f-5d08-4653-9c8e-a54d10f0ce98 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:41.810175 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-b88c123e-38d7-45d1-9fc4-ea8cfa067822 req-f064e90f-5d08-4653-9c8e-a54d10f0ce98 service nova] Creating event network-vif-deleted:1a1c1f16-2915-4829-ae7b-b060500e16cd for instance 81773ee2-5bed-4fab-919c-792a6a2878cf on hv-cinder-85220 Aug 05 19:54:41.819004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-b88c123e-38d7-45d1-9fc4-ea8cfa067822 req-f064e90f-5d08-4653-9c8e-a54d10f0ce98 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088986 Aug 05 19:54:41.820679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 301/592] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:41.908601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:41.919920 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-89a4b290-37a8-4763-a0ef-1dc4f88c4728 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1310 microversion: 2.1 time: 0.203601 Aug 05 19:54:41.921136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 292/593] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:41 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1310 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:42.467370 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:42.468237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:42.483255 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:42.485686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:42.486403 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:42.487442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:42.488157 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:42.488846 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:42.547975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:42.549133 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:42.550052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:42.551081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lazy-loading 'fault' on Instance uuid 81773ee2-5bed-4fab-919c-792a6a2878cf {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:54:42.656487 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfba24ac674454d86e415b38c0c4618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018e12e98f1143d6acaf348cfea45763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:42.663942 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-afd40743-d67e-436b-b6a3-095778a2c422 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 200 len: 1308 microversion: 2.1 time: 0.201422 Aug 05 19:54:42.664764 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 302/594] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:42 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:42.815684 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4ddc964a-27f6-478b-bee6-ebf8eeff26a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'create', calling method: .version_select at 0x7f18c80120d0>, body: {"keypair": {"name": "tempest-keypair-1993786936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnCZeHVHoNj4Z4fZqbCLgBD1F2rwNuivoHQViFqGNbHqSSLmPYkfnxrgUXgtKiBzIocrx88FexGMMtWuPcZxuxIJEzepC0GHN1I7jR8RKcG66Ng3tqqph7nHnaqWWOUfw=="}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:42.834653 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-4ddc964a-27f6-478b-bee6-ebf8eeff26a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Getting quotas for project 9be735c81c7a41b8a482e8f72a71bdef. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:54:42.839682 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-4ddc964a-27f6-478b-bee6-ebf8eeff26a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Getting quotas for user e8f7435928a74258af5478959bd939bb and project 9be735c81c7a41b8a482e8f72a71bdef. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:54:42.875201 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4ddc964a-27f6-478b-bee6-ebf8eeff26a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.063130 Aug 05 19:54:42.877328 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 293/595] 10.222.0.86 () {62 vars in 1200 bytes} [Fri Aug 5 19:54:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:42.943302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:42.944171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:42.952278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:42.952840 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:42.953481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:42.954645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:42.955114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:42.955542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:43.335673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:43.344791 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d4d5c8f9-3039-4e29-a81f-965df2d11717 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1365 microversion: 2.1 time: 0.407092 Aug 05 19:54:43.359888 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 303/596] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:42 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:43.688310 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:43.689316 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] [instance: 81773ee2-5bed-4fab-919c-792a6a2878cf] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:43.695977 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:43.696482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:43.697069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:43.697792 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:43.698263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:43.698852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:43.719624 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] HTTP exception thrown: Instance 81773ee2-5bed-4fab-919c-792a6a2878cf could not be found. Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Request method failure captured: Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf HTTP/1.1 Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XT4x5aowKvwkIqK7nkk9zdHjj_iu1QBV_M0wSNViP3nxbSgduRRjahdLQdvWusTZWLA7LbAmsQBnSJJtujedJDWIEJj5ith0JH5ZW1LHOO6CNvTsSBg5u4vaMEMaYdrV5IjcEZ_Pb1l0AP5EF9lPEwUU65MxeCBovb-H-v-uxjTPUo Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 018e12e98f1143d6acaf348cfea45763 Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1603621904 Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:54:43.721468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/018e12e98f1143d6acaf348cfea45763"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/018e12e98f1143d6acaf348cfea45763"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_018e12e98f1143d6acaf348cfea45763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/018e12e98f1143d6acaf348cfea45763"}]}] Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-VolumesSnapshotTestJSON-1603621904 Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 018e12e98f1143d6acaf348cfea45763 Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1603621904 Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-VolumesSnapshotTestJSON-1603621904-project Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: acfba24ac674454d86e415b38c0c4618 Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-VolumesSnapshotTestJSON-1603621904-project Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 81773ee2-5bed-4fab-919c-792a6a2878cf could not be found. Aug 05 19:54:43.722755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '81773ee2-5bed-4fab-919c-792a6a2878cf'} Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81773ee2-5bed-4fab-919c-792a6a2878cf could not be found. Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:54:43.724188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81773ee2-5bed-4fab-919c-792a6a2878cf could not be found. Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81773ee2-5bed-4fab-919c-792a6a2878cf could not be found. Aug 05 19:54:43.726393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:54:43.729935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] Returning 404 to user: Instance 81773ee2-5bed-4fab-919c-792a6a2878cf could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:54:43.729935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a645bcea-1db3-4ebd-9f88-a72b63ef8f43 tempest-VolumesSnapshotTestJSON-1603621904 tempest-VolumesSnapshotTestJSON-1603621904-project] 10.222.0.86 "GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf" status: 404 len: 111 microversion: 2.1 time: 0.039677 Aug 05 19:54:43.729935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 294/597] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:43 2022] GET /compute/v2.1/servers/81773ee2-5bed-4fab-919c-792a6a2878cf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:54:43.839207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-324450e1-2366-42af-a7d7-d7ebdab333b4 req-33119369-741c-4377-a138-cab2f3e50d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75eabf8-c187-4e38-afe7-c8f017f3a3f3", "tag": "2fa04866-048e-4c7e-aa04-cbd556836f35"}, {"name": "network-changed", "server_uuid": "e75eabf8-c187-4e38-afe7-c8f017f3a3f3", "tag": "2fa04866-048e-4c7e-aa04-cbd556836f35"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:43.852798 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-324450e1-2366-42af-a7d7-d7ebdab333b4 req-33119369-741c-4377-a138-cab2f3e50d9f service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:43.853971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-324450e1-2366-42af-a7d7-d7ebdab333b4 req-33119369-741c-4377-a138-cab2f3e50d9f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:43.855052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-324450e1-2366-42af-a7d7-d7ebdab333b4 req-33119369-741c-4377-a138-cab2f3e50d9f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:43.876326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-324450e1-2366-42af-a7d7-d7ebdab333b4 req-33119369-741c-4377-a138-cab2f3e50d9f service nova] Creating event network-changed:2fa04866-048e-4c7e-aa04-cbd556836f35 for instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 on hv-cinder-85220 Aug 05 19:54:43.881609 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-324450e1-2366-42af-a7d7-d7ebdab333b4 req-33119369-741c-4377-a138-cab2f3e50d9f service nova] Creating event network-changed:2fa04866-048e-4c7e-aa04-cbd556836f35 for instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 on hv-cinder-85220 Aug 05 19:54:43.890773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-324450e1-2366-42af-a7d7-d7ebdab333b4 req-33119369-741c-4377-a138-cab2f3e50d9f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053882 Aug 05 19:54:43.891999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 304/598] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:44.382281 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:44.384869 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-b0918333-4d8d-437f-9565-20bdd43434a7 req-116a0e45-6c65-4b80-86f6-0714714751d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acffbb62-5c10-4d55-ad26-3e31f8ade0e6", "tag": "89a6562f-7178-496c-870e-966a548a5192"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:44.393026 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:44.401081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:44.404115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:44.404568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:44.405821 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:44.409357 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b0918333-4d8d-437f-9565-20bdd43434a7 req-116a0e45-6c65-4b80-86f6-0714714751d0 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:44.409953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b0918333-4d8d-437f-9565-20bdd43434a7 req-116a0e45-6c65-4b80-86f6-0714714751d0 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:44.410466 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b0918333-4d8d-437f-9565-20bdd43434a7 req-116a0e45-6c65-4b80-86f6-0714714751d0 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:44.411360 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:44.412184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:44.430008 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-b0918333-4d8d-437f-9565-20bdd43434a7 req-116a0e45-6c65-4b80-86f6-0714714751d0 service nova] Creating event network-changed:89a6562f-7178-496c-870e-966a548a5192 for instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 on hv-cinder-85220 Aug 05 19:54:44.437566 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-b0918333-4d8d-437f-9565-20bdd43434a7 req-116a0e45-6c65-4b80-86f6-0714714751d0 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070179 Aug 05 19:54:44.440114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 305/599] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:44.791335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:44.801971 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0e6cec9b-47d5-4dd0-9a02-9209b5e05205 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1365 microversion: 2.1 time: 0.440000 Aug 05 19:54:44.802752 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 295/600] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:44 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:45.796912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-765709886", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb527552-98d6-4b05-a3cd-e58cc7214595"}], "security_groups": [{"name": "tempest-securitygroup--1534908914"}], "key_name": "tempest-keypair-1993786936", "user_data": "}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:45.827216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:45.827959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:45.834733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:45.835311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:45.835828 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:45.836717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:45.837181 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:45.837737 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:45.907602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] validate_networks() for [('cb527552-98d6-4b05-a3cd-e58cc7214595', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:54:45.974732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:45.983753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dfebeaf4-97fa-479e-aa76-f80c30946c98 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1365 microversion: 2.1 time: 0.160046 Aug 05 19:54:45.984244 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 296/601] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:45 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:54:46.307295 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:54:46.307728 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:54:46.308209 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:54:46.308624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:54:46.309038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:54:46.318302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:46.318818 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:46.319257 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:46.319990 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:46.320713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:46.321147 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:46.339964 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Getting quotas for project 9be735c81c7a41b8a482e8f72a71bdef. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:54:46.345143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Getting quotas for user e8f7435928a74258af5478959bd939bb and project 9be735c81c7a41b8a482e8f72a71bdef. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:54:46.357506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:54:46.359924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:54:46.410982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3cd76e8f-f1a1-45bb-8e5c-7a2af971ac5f tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.619281 Aug 05 19:54:46.411917 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 306/602] 10.222.0.86 () {62 vars in 1188 bytes} [Fri Aug 5 19:54:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 19:54:46.423363 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-37bd8de5-6042-4013-b31d-2c3c0ca8f169 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:46.424070 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-37bd8de5-6042-4013-b31d-2c3c0ca8f169 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:46.483539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-37bd8de5-6042-4013-b31d-2c3c0ca8f169 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:46.491155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-37bd8de5-6042-4013-b31d-2c3c0ca8f169 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:46.493106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-37bd8de5-6042-4013-b31d-2c3c0ca8f169 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:46.494250 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-37bd8de5-6042-4013-b31d-2c3c0ca8f169 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1281 microversion: 2.20 time: 0.074758 Aug 05 19:54:46.494846 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 297/603] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:46 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:47.006139 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:47.006732 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:47.013043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:47.013529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:47.013969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:47.014769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:47.015226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:47.015655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:47.153161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:47.161285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-af00b2b3-0969-43d3-8831-febf4457bef4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1365 microversion: 2.1 time: 0.159689 Aug 05 19:54:47.161858 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 307/604] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:47 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:47.517638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:47.518251 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:47.525421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:47.525914 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:47.526362 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:47.527155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:47.527618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:47.528049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:47.592774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:47.600884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:47.602902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:47.604017 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7fd472b2-5fa9-4a76-9a1e-1a49cd49d980 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1285 microversion: 2.20 time: 0.090377 Aug 05 19:54:47.604580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 298/605] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:47 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:48.184018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:48.184571 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:48.191058 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:48.191549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:48.191992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:48.192695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:48.193153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:48.193582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:48.342519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:48.346153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:48.353901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3c995e21-ffe5-4fcf-8217-1f58be6217b3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1365 microversion: 2.1 time: 0.173287 Aug 05 19:54:48.353901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 308/606] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:48 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:48.629537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:48.630311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:48.640947 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:48.641440 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:48.641882 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:48.642582 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:48.643059 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:48.645774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:48.721805 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:48.732256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:48.733752 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:48.734890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f391dfad-d6df-4cf4-9b02-069e48948b6d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1285 microversion: 2.20 time: 0.109284 Aug 05 19:54:48.735628 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 299/607] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:48 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:49.373748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:49.374364 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:49.382105 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:49.383335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:49.384047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:49.384758 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:49.385209 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:49.385632 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:49.629025 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:49.639654 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9e019e1f-d60a-480b-9a2a-7e2f4a2e30e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1365 microversion: 2.1 time: 0.269605 Aug 05 19:54:49.654079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 309/608] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:49 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:49.758499 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:49.759272 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:49.765683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:49.766288 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:49.766840 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:49.767627 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:49.768170 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:49.768665 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:49.791521 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-ea1abafd-c9c4-44ab-b705-94fc1a787c72 req-1fd4575c-0554-4c2a-bae0-927acd7d0a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acffbb62-5c10-4d55-ad26-3e31f8ade0e6", "name": "network-vif-plugged", "status": "completed", "tag": "89a6562f-7178-496c-870e-966a548a5192"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:49.804164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ea1abafd-c9c4-44ab-b705-94fc1a787c72 req-1fd4575c-0554-4c2a-bae0-927acd7d0a71 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:49.805244 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ea1abafd-c9c4-44ab-b705-94fc1a787c72 req-1fd4575c-0554-4c2a-bae0-927acd7d0a71 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:49.805683 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-ea1abafd-c9c4-44ab-b705-94fc1a787c72 req-1fd4575c-0554-4c2a-bae0-927acd7d0a71 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:49.834812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-ea1abafd-c9c4-44ab-b705-94fc1a787c72 req-1fd4575c-0554-4c2a-bae0-927acd7d0a71 service nova] Creating event network-vif-plugged:89a6562f-7178-496c-870e-966a548a5192 for instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 on hv-cinder-85220 Aug 05 19:54:49.841353 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-ea1abafd-c9c4-44ab-b705-94fc1a787c72 req-1fd4575c-0554-4c2a-bae0-927acd7d0a71 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053302 Aug 05 19:54:49.842053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 310/609] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:54:49.881699 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:49.902890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:49.907348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:49.908899 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-055bcae2-adf8-45c0-8cdd-2e2beec6d7a9 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1333 microversion: 2.20 time: 0.154904 Aug 05 19:54:49.909597 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 300/610] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:49 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:54:50.661989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:50.662724 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:50.670305 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:50.671029 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:50.671802 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:50.672172 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:50.672619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:50.673047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:50.812590 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:50.821471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e69f67b0-d557-4857-87f6-987157e9f648 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1365 microversion: 2.1 time: 0.163783 Aug 05 19:54:50.822427 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 311/611] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:50 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:50.933491 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:50.934120 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:50.941496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:50.942288 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:50.942809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:50.944026 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:50.944497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:50.945119 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:51.099863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:51.109025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:51.110524 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:51.111701 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-1e53ce50-e293-4f67-8225-5dd7a01016ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.182365 Aug 05 19:54:51.112265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 301/612] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:50 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:54:51.845207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:51.846577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:51.849748 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-f9d9f6f6-4189-4447-897a-d7da0151d2f2 req-a8bf2bec-1642-4540-a2b1-ecd215bf864c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9826c-1788-4efe-951b-1092fead7ea9", "tag": "a01a901d-1174-4772-9aa0-c8525d67930c"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:51.857547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:51.858287 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:51.858964 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:51.859862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:51.860511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:51.861136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:51.861483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f9d9f6f6-4189-4447-897a-d7da0151d2f2 req-a8bf2bec-1642-4540-a2b1-ecd215bf864c service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:51.862160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f9d9f6f6-4189-4447-897a-d7da0151d2f2 req-a8bf2bec-1642-4540-a2b1-ecd215bf864c service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:51.862597 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f9d9f6f6-4189-4447-897a-d7da0151d2f2 req-a8bf2bec-1642-4540-a2b1-ecd215bf864c service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:51.875848 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-f9d9f6f6-4189-4447-897a-d7da0151d2f2 req-a8bf2bec-1642-4540-a2b1-ecd215bf864c service nova] Creating event network-changed:a01a901d-1174-4772-9aa0-c8525d67930c for instance cca9826c-1788-4efe-951b-1092fead7ea9 on hv-cinder-85220 Aug 05 19:54:51.890230 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-f9d9f6f6-4189-4447-897a-d7da0151d2f2 req-a8bf2bec-1642-4540-a2b1-ecd215bf864c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044439 Aug 05 19:54:51.891204 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 302/613] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:52.006041 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:52.014210 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-924a9621-02fa-4ef6-b4c5-83f0be0aa156 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1365 microversion: 2.1 time: 0.173809 Aug 05 19:54:52.014917 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 312/614] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:51 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:52.135980 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:52.136594 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:52.143679 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:52.144157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:52.144598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:52.145297 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:52.145751 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:52.146177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:52.329729 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:52.338978 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:52.340758 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:52.342064 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c028c37c-f4ad-4711-acac-f322d64b2912 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.211355 Aug 05 19:54:52.342844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 303/615] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:52 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:53.036693 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:53.037597 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:53.045500 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:53.045994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:53.046462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:53.047194 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:53.047656 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:53.048112 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:53.189129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:53.197288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1d268c57-a4cd-4f9d-8bb5-c997ad9a1ef0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1554 microversion: 2.1 time: 0.164644 Aug 05 19:54:53.197889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 313/616] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:54:53 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:54:53.218295 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:53.218851 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:53.225324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:53.225815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:53.226893 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:53.227613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:53.228101 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:53.228532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:53.309761 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3b7e1b94-b4ef-4f28-bde8-731d15f0fccc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095338 Aug 05 19:54:53.310375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 304/617] 10.222.0.86 () {58 vars in 1275 bytes} [Fri Aug 5 19:54:53 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:53.430245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:53.430618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:53.437246 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:53.437814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:53.438460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:53.439283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:53.439795 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:53.440830 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:53.580718 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:53.590063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:53.591613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:53.592739 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-52bab165-fbb7-4fce-82a9-313897325c47 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.226129 Aug 05 19:54:53.593301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 314/618] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:53 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:54.318904 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-14d864cb-546a-40fb-a2c5-020ebbb5aad6 req-857c1039-50cf-4ecb-ad18-bbb3d2566b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acffbb62-5c10-4d55-ad26-3e31f8ade0e6", "tag": "89a6562f-7178-496c-870e-966a548a5192"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:54.328926 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-14d864cb-546a-40fb-a2c5-020ebbb5aad6 req-857c1039-50cf-4ecb-ad18-bbb3d2566b10 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:54.329673 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-14d864cb-546a-40fb-a2c5-020ebbb5aad6 req-857c1039-50cf-4ecb-ad18-bbb3d2566b10 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:54.330149 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-14d864cb-546a-40fb-a2c5-020ebbb5aad6 req-857c1039-50cf-4ecb-ad18-bbb3d2566b10 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:54.342299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-14d864cb-546a-40fb-a2c5-020ebbb5aad6 req-857c1039-50cf-4ecb-ad18-bbb3d2566b10 service nova] Creating event network-changed:89a6562f-7178-496c-870e-966a548a5192 for instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 on hv-cinder-85220 Aug 05 19:54:54.347513 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-14d864cb-546a-40fb-a2c5-020ebbb5aad6 req-857c1039-50cf-4ecb-ad18-bbb3d2566b10 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032937 Aug 05 19:54:54.348124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 305/619] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:54:54.615610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:54.616296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:54.623185 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:54.623678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:54.624122 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:54.624843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:54.625299 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:54.625789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:54.770204 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:54.781309 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:54.782899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:54.784029 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ac9e39bf-0bf9-4c92-b730-62307b8fb4a7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.172359 Aug 05 19:54:54.784630 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 315/620] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:54 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:55.810044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:55.810771 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:55.817073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:55.817551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:55.817984 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:55.818716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:55.819166 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:55.819586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:55.962467 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:55.970800 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:55.972347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:55.973497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2dd97535-1b12-498c-954d-23f6d46c85c7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.168913 Aug 05 19:54:55.974115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 306/621] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:55 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:54:56.998275 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:56.999333 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:57.001887 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=4 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:57.002925 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=12 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:57.008480 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:57.008664 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:57.009124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:57.010311 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:57.010799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:57.011220 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:57.150102 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:57.160003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:57.161675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:57.162941 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-02cca1e9-5a1e-4c7d-9e89-ca34c0c5a57e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.168704 Aug 05 19:54:57.163943 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 316/622] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:56 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:58.186579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:58.187343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:58.189384 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=12 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:58.196006 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:58.196507 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:58.196951 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:58.197662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:58.198127 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:58.198558 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:58.348399 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:58.357083 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:58.358658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:58.360628 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fa576fb8-a9de-48d1-86d6-5d783923ea35 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.177771 Aug 05 19:54:58.361538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 307/623] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:58 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:59.388574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:59.389186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:54:59.395652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:59.396136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:59.396572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:59.397277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:59.397769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:59.398261 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:59.537671 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:59.547027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:59.548804 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:54:59.550326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-47b0f0b9-d325-4d77-b0a4-24fe820bfafe tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.165614 Aug 05 19:54:59.550678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 317/624] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:54:59 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:54:59.819189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-34e45e2d-969d-4028-93ae-dcff00434c9c req-048fac3c-a238-4ef9-b76e-b503b0012727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9826c-1788-4efe-951b-1092fead7ea9", "name": "network-vif-plugged", "status": "completed", "tag": "a01a901d-1174-4772-9aa0-c8525d67930c"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:54:59.831427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-34e45e2d-969d-4028-93ae-dcff00434c9c req-048fac3c-a238-4ef9-b76e-b503b0012727 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:59.832095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-34e45e2d-969d-4028-93ae-dcff00434c9c req-048fac3c-a238-4ef9-b76e-b503b0012727 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:59.832610 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-34e45e2d-969d-4028-93ae-dcff00434c9c req-048fac3c-a238-4ef9-b76e-b503b0012727 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:59.845019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-34e45e2d-969d-4028-93ae-dcff00434c9c req-048fac3c-a238-4ef9-b76e-b503b0012727 service nova] Creating event network-vif-plugged:a01a901d-1174-4772-9aa0-c8525d67930c for instance cca9826c-1788-4efe-951b-1092fead7ea9 on hv-cinder-85220 Aug 05 19:54:59.851139 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-34e45e2d-969d-4028-93ae-dcff00434c9c req-048fac3c-a238-4ef9-b76e-b503b0012727 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036364 Aug 05 19:54:59.851819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 308/625] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:00.574697 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:00.575351 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:00.582125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:00.582339 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:00.585013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:00.585013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:00.585013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:00.585013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:00.734064 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:00.744268 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:00.745778 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:00.747203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ca241e05-a5d9-4cc5-80f7-656b51560d75 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1407 microversion: 2.20 time: 0.177541 Aug 05 19:55:00.747955 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 318/626] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:55:00 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:55:01.772741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:01.773813 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:01.780804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:01.781314 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:01.781794 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:01.782486 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:01.782989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:01.783423 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:01.967382 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:01.980010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:01.981784 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:01.983081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a6846507-ee5b-4656-ac75-21a280ad49e0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1599 microversion: 2.20 time: 0.215612 Aug 05 19:55:01.983871 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 309/627] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:55:01 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:55:02.006165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:02.006748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:02.014508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:02.015024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:02.015458 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:02.016760 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:02.017076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:02.017503 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:02.112101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9adc872d-a134-4673-b0e9-234c3ece0e9a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.109709 Aug 05 19:55:02.112728 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 319/628] 10.222.0.86 () {60 vars in 1316 bytes} [Fri Aug 5 19:55:02 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:55:03.433672 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-9c7a4b6c-9304-4149-87c7-51946d615cdc req-6904481d-e201-41fb-9c17-6d5dafdc4551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9826c-1788-4efe-951b-1092fead7ea9", "tag": "a01a901d-1174-4772-9aa0-c8525d67930c"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:03.444934 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9c7a4b6c-9304-4149-87c7-51946d615cdc req-6904481d-e201-41fb-9c17-6d5dafdc4551 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:03.445882 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9c7a4b6c-9304-4149-87c7-51946d615cdc req-6904481d-e201-41fb-9c17-6d5dafdc4551 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:03.446025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9c7a4b6c-9304-4149-87c7-51946d615cdc req-6904481d-e201-41fb-9c17-6d5dafdc4551 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:03.459103 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-9c7a4b6c-9304-4149-87c7-51946d615cdc req-6904481d-e201-41fb-9c17-6d5dafdc4551 service nova] Creating event network-changed:a01a901d-1174-4772-9aa0-c8525d67930c for instance cca9826c-1788-4efe-951b-1092fead7ea9 on hv-cinder-85220 Aug 05 19:55:03.464964 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-9c7a4b6c-9304-4149-87c7-51946d615cdc req-6904481d-e201-41fb-9c17-6d5dafdc4551 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034991 Aug 05 19:55:03.465590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 310/629] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:07.557340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:07.560157 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:07.568983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:07.570808 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:07.571602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:07.572552 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:07.573182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:07.573791 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:07.623531 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5c020b71-31e1-489b-8682-9e68d64337ff tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074274 Aug 05 19:55:07.624117 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 320/630] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:55:07 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:55:07.731159 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:07.731763 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:07.740129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:07.740640 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:07.741793 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:07.742783 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:07.743478 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:07.743915 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:07.747115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=100 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:07.774421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:55:07.883665 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c29a7e87-690c-4bff-aa97-9f986e1fba6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 204 len: 0 microversion: 2.1 time: 0.158189 Aug 05 19:55:07.885381 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 311/631] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:55:07 2022] DELETE /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:55:07.898210 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:07.898873 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:07.911837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:07.912727 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:07.913999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:07.914775 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:07.915257 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:07.915691 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:08.079696 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:08.089605 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-16bb6a1f-8bac-4185-9feb-4853885df3e0 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1675 microversion: 2.1 time: 0.199157 Aug 05 19:55:08.090285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 321/632] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:07 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:09.113851 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:09.114642 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:09.123774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:09.124767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:09.125218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:09.125989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:09.126448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:09.126908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:09.300661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:09.312352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dc9b3b60-43b2-4bc8-bad4-db451d5c5248 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1675 microversion: 2.1 time: 0.203353 Aug 05 19:55:09.314187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 312/633] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:09 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:10.347004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:10.347691 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:10.355491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:10.355606 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:10.355978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:10.356716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:10.357215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:10.357769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:10.514414 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:10.522742 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c88f2f71-8079-44b7-ba5f-f4e982e2aa9e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1675 microversion: 2.1 time: 0.179513 Aug 05 19:55:10.523310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 322/634] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:10 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:11.547364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:11.548141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:11.550908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:11.556948 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:11.557540 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:11.558068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:11.558885 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:11.559413 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:11.559910 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:11.632174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:11.645157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-91caf49f-2ece-4c34-9f03-09d28f18eeaa tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1607 microversion: 2.1 time: 0.097096 Aug 05 19:55:11.645157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 313/635] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:11 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1607 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:11.706866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-295433b1-23b9-4de3-8a8c-adda51c6d752 req-fe3aaaff-92d6-4785-8f64-3ebdf46a3cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8482cf3d-db2a-41f0-93d3-dece8a8a46f1", "name": "network-vif-deleted", "tag": "bdb9fdac-1be5-4013-b134-a99d9d0e368f"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:11.717760 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-295433b1-23b9-4de3-8a8c-adda51c6d752 req-fe3aaaff-92d6-4785-8f64-3ebdf46a3cb1 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:11.718260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-295433b1-23b9-4de3-8a8c-adda51c6d752 req-fe3aaaff-92d6-4785-8f64-3ebdf46a3cb1 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:11.719136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-295433b1-23b9-4de3-8a8c-adda51c6d752 req-fe3aaaff-92d6-4785-8f64-3ebdf46a3cb1 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:11.731189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-295433b1-23b9-4de3-8a8c-adda51c6d752 req-fe3aaaff-92d6-4785-8f64-3ebdf46a3cb1 service nova] Creating event network-vif-deleted:bdb9fdac-1be5-4013-b134-a99d9d0e368f for instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 on hv-cinder-85220 Aug 05 19:55:11.736647 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-295433b1-23b9-4de3-8a8c-adda51c6d752 req-fe3aaaff-92d6-4785-8f64-3ebdf46a3cb1 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033429 Aug 05 19:55:11.737250 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 323/636] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:12.664270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:12.665615 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:12.673843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:12.674999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:12.675593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:12.676413 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:12.676987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:12.677645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:12.750555 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:12.758507 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-cae550f4-9a03-4ce3-bcf1-2f46500815eb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1323 microversion: 2.1 time: 0.098077 Aug 05 19:55:12.759131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 314/637] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:12 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1323 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:13.780119 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:13.781027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:13.783088 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:13.788564 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:13.789055 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:13.789505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:13.790610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:13.791278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:13.791278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:13.826903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:13.827386 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:13.827816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:13.828256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lazy-loading 'fault' on Instance uuid 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:55:13.871391 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:13.879398 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c7156ac5-dd1a-46a7-98dc-340a5e5ab125 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 200 len: 1328 microversion: 2.1 time: 0.104138 Aug 05 19:55:13.880128 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 324/638] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:13 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:14.901330 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:14.902162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:14.909341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:14.909956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:14.910517 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:14.911395 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:14.912037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:14.912564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:14.927350 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] HTTP exception thrown: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Request method failure captured: Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 HTTP/1.1 Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRh2onWclJE9pSVd8UUFtQu8ImB7b6dp8OcMAVEOkZx6yK7J2VZ856El7MpgJbMZrDosXRjOqd50LkaVdRzu2b_94rfaZopuQodwH7PbEQgngY1T-ptP16UjnSaVat3eANjfRrHY9eyp6gfsdHxs7OQlrO45KfV_qNSa25gPi0FpG0 Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:55:14.929279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}] Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 074f3ddb689c4a60a05d3267080d7e7a Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:55:14.931556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '8482cf3d-db2a-41f0-93d3-dece8a8a46f1'} Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:55:14.932375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:55:14.934010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:14.935569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Returning 404 to user: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:55:14.935569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8d3b277a-69c2-4f48-aa88-a2ad3345d867 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 404 len: 111 microversion: 2.1 time: 0.034498 Aug 05 19:55:14.935569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 315/639] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:14 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:55:14.944194 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-84c14af4-7ae4-4b8e-aa51-f6525c0daaa3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '.version_select at 0x7f18c81594c0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:14.964224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-84c14af4-7ae4-4b8e-aa51-f6525c0daaa3 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897978087" status: 202 len: 0 microversion: 2.1 time: 0.026697 Aug 05 19:55:14.964914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 325/640] 10.222.0.86 () {58 vars in 1221 bytes} [Fri Aug 5 19:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897978087 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:55:15.670857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-308f5e38-0694-4f53-851a-d661cc6ba532 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'create', calling method: .version_select at 0x7f18c37863a0>, body: {"keypair": {"name": "tempest-keypair-2146204634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETgqdnCW5zgOZF4ZARl1odmT5mMz7Gtk54FvsJtWZ+YhbVpznEydLYcnm6dCPRfUOxzTqhnES+dw7jUMrc1H6fPzwXGtekZ+Fq+TvHIaQmbCAIumXcJN4aVVEAiGP0d3Q=="}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:15.687985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-308f5e38-0694-4f53-851a-d661cc6ba532 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Getting quotas for project 21db26f543ab4a67b932184ba810f4e9. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:55:15.693525 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-308f5e38-0694-4f53-851a-d661cc6ba532 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Getting quotas for user 074f3ddb689c4a60a05d3267080d7e7a and project 21db26f543ab4a67b932184ba810f4e9. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:55:15.721280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-308f5e38-0694-4f53-851a-d661cc6ba532 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054339 Aug 05 19:55:15.722056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 316/641] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:55:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:55:17.379215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-464737441", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b655173a-c5d2-4f9a-9482-e2776ef4231e"}], "security_groups": [{"name": "tempest-securitygroup--1654713215"}], "key_name": "tempest-keypair-2146204634", "user_data": "}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:17.494780 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] validate_networks() for [('b655173a-c5d2-4f9a-9482-e2776ef4231e', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:55:18.060402 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:55:18.060936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:55:18.061437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:55:18.061861 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:55:18.062266 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:55:18.072474 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:18.072959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:18.073387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:18.074107 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:18.074595 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:18.075003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:18.093680 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Getting quotas for project 21db26f543ab4a67b932184ba810f4e9. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:55:18.097645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Getting quotas for user 074f3ddb689c4a60a05d3267080d7e7a and project 21db26f543ab4a67b932184ba810f4e9. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:55:18.111879 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:55:18.115193 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:55:18.169069 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9276feac-9835-4ec4-986b-7d87fe2296e2 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.794357 Aug 05 19:55:18.177104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 326/642] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:55:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:55:18.181785 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4e047f18-7dc7-4c13-afae-48974b7c2c98 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:18.182411 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4e047f18-7dc7-4c13-afae-48974b7c2c98 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:18.249261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4e047f18-7dc7-4c13-afae-48974b7c2c98 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:18.259573 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4e047f18-7dc7-4c13-afae-48974b7c2c98 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1237 microversion: 2.1 time: 0.081597 Aug 05 19:55:18.260814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 317/643] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:18 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:19.282083 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:19.283532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:19.290808 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:19.291302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:19.291733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:19.292662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:19.293141 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:19.293799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:19.369028 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:19.376865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e6c5669c-9f86-41be-984b-60698d10868a tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1289 microversion: 2.1 time: 0.099467 Aug 05 19:55:19.377458 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 327/644] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:19 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:20.401354 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:20.405461 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:20.442713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:20.442713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:20.442713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:20.443310 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:20.443773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:20.444274 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:20.808506 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:20.828078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3e7666ea-dd58-4bc3-ba2d-49fe11b4e3bd tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.429922 Aug 05 19:55:20.844046 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 318/645] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:20 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:21.851343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:21.852991 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:21.866924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:21.868604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:21.871423 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:21.872477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:21.874771 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:21.875976 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:21.958747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-941db04b-8441-4632-899f-8d3c7309b8e7 req-9b1704de-5d1d-456c-8837-bdcf2ea06bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6", "tag": "f7c6c3d7-c542-4392-baac-c0cb1d1a7ee6"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:21.981558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-941db04b-8441-4632-899f-8d3c7309b8e7 req-9b1704de-5d1d-456c-8837-bdcf2ea06bd9 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:21.982231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-941db04b-8441-4632-899f-8d3c7309b8e7 req-9b1704de-5d1d-456c-8837-bdcf2ea06bd9 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:21.982677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-941db04b-8441-4632-899f-8d3c7309b8e7 req-9b1704de-5d1d-456c-8837-bdcf2ea06bd9 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:22.008355 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=98 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:22.019998 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-941db04b-8441-4632-899f-8d3c7309b8e7 req-9b1704de-5d1d-456c-8837-bdcf2ea06bd9 service nova] Creating event network-changed:f7c6c3d7-c542-4392-baac-c0cb1d1a7ee6 for instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 on hv-cinder-85220 Aug 05 19:55:22.049869 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-941db04b-8441-4632-899f-8d3c7309b8e7 req-9b1704de-5d1d-456c-8837-bdcf2ea06bd9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351703 Aug 05 19:55:22.050916 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 328/646] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:22.290249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:22.320219 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9df23a6c-5d98-4aa1-a05b-a830bf191366 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.468810 Aug 05 19:55:22.322997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 319/647] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:21 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:23.347690 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:23.347690 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:23.353104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:23.353717 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:23.354223 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:23.355043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:23.355576 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:23.356094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:23.650668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:23.674245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-52787a5f-c5c5-41a1-a03b-0a95b2b7e137 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.332209 Aug 05 19:55:23.678346 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 329/648] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:23 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:24.325646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:24.326549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:24.344496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:24.345232 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:24.345849 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:24.346774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:24.347678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:24.348280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:24.490943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lazy-loading 'services' on Instance uuid e75eabf8-c187-4e38-afe7-c8f017f3a3f3 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:55:24.587497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-83fe1abc-a2ae-495c-92bc-9e591f952790 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "DELETE /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments/f1814c80-35c1-487f-9219-8524f85f778d" status: 202 len: 0 microversion: 2.1 time: 0.265383 Aug 05 19:55:24.588397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 320/649] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:55:24 2022] DELETE /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments/f1814c80-35c1-487f-9219-8524f85f778d => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:55:24.596783 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:24.599995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:24.608057 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:24.608832 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:24.609511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:24.610524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:24.611051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:24.611509 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:24.663864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5ac58a02-529d-4829-90e2-b17a345346a3 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070923 Aug 05 19:55:24.666883 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 330/650] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:55:24 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:24.698086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:24.698823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:24.706098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:24.706755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:24.707203 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:24.708141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:24.708604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:24.709067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:24.897666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:24.914829 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5734b024-7a5d-412e-8cb7-6e839870bd6b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.221618 Aug 05 19:55:24.918670 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 321/651] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:24 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:25.687719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:25.691481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:25.703736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:25.704635 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:25.705702 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:25.707220 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:25.708072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:25.708855 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:25.768276 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3483c7d7-8aea-4bc2-87c8-fbd669a66d0d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088338 Aug 05 19:55:25.769340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 331/652] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:55:25 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:55:25.856960 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:25.858570 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:25.873510 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:25.874210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:25.875035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:25.878056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:25.878697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:25.879255 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:25.936912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:25.937648 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:25.946084 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:55:25.947705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:25.950982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:25.951460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:25.954272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:25.954950 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:25.955546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:26.066175 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-aa55558e-78fd-421c-9a22-24b393ab2691 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "DELETE /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 204 len: 0 microversion: 2.1 time: 0.212950 Aug 05 19:55:26.066824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 322/653] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:55:25 2022] DELETE /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:55:26.083609 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:26.084317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:26.091585 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:26.092472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:26.093086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:26.094173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:26.095259 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:26.096056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:26.149399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:26.158305 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0a58f301-da66-4175-b6df-f98c39ac78ca tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.225298 Aug 05 19:55:26.169772 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 332/654] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:25 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:26.183142 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-88a1cb02-01e9-485f-9b00-1e39a02b01cd req-51f8a0cc-a054-4287-abc9-f599a1e68496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6", "name": "network-vif-plugged", "status": "completed", "tag": "f7c6c3d7-c542-4392-baac-c0cb1d1a7ee6"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:26.192849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-88a1cb02-01e9-485f-9b00-1e39a02b01cd req-51f8a0cc-a054-4287-abc9-f599a1e68496 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:26.193596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-88a1cb02-01e9-485f-9b00-1e39a02b01cd req-51f8a0cc-a054-4287-abc9-f599a1e68496 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:26.194030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-88a1cb02-01e9-485f-9b00-1e39a02b01cd req-51f8a0cc-a054-4287-abc9-f599a1e68496 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:26.206437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-88a1cb02-01e9-485f-9b00-1e39a02b01cd req-51f8a0cc-a054-4287-abc9-f599a1e68496 service nova] Creating event network-vif-plugged:f7c6c3d7-c542-4392-baac-c0cb1d1a7ee6 for instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 on hv-cinder-85220 Aug 05 19:55:26.213220 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-88a1cb02-01e9-485f-9b00-1e39a02b01cd req-51f8a0cc-a054-4287-abc9-f599a1e68496 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035094 Aug 05 19:55:26.214024 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 333/655] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:26.394647 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:26.404498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d6ce80f4-5320-48f7-9f2b-643481b796d8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1691 microversion: 2.1 time: 0.330147 Aug 05 19:55:26.405496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 323/656] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:26 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1691 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:27.182663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:27.183541 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:27.190935 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:27.191518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:27.192136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:27.193010 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:27.193736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:27.194581 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:27.358792 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:27.376398 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-768fe052-ee45-417d-9b7d-7044fd915a0b tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.191165 Aug 05 19:55:27.389725 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 334/657] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:27 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:27.425756 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:27.427249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:27.434133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:27.434731 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:27.435145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:27.436289 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:27.437102 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:27.437424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:27.896757 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:27.909109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8ea6273a-7b45-410d-be63-1b540407f4db tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1691 microversion: 2.1 time: 0.487522 Aug 05 19:55:27.910368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 324/658] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:27 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1691 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:28.402165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:28.403746 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:28.409428 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:28.410738 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=6 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:28.412949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:28.413440 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:28.413907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:28.414797 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:28.415416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:28.415851 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:28.650411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:28.663904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2fad9bf8-80a3-4a7c-bd00-03b1cfd85413 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.267324 Aug 05 19:55:28.665430 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 335/659] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:28 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:28.932741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:28.934380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:28.937970 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=6 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:28.952504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:28.953011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:28.953469 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:28.954218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:28.954711 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:28.955154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:29.195145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:29.203612 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3992dbc6-40d6-47db-a1db-bf8289d22d6e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1691 microversion: 2.1 time: 0.276170 Aug 05 19:55:29.218326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 325/660] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:28 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1691 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:29.702221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:29.708518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:29.729626 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:29.731472 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:29.732006 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:29.734295 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:29.735754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:29.737572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:30.036352 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:30.051251 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-96a129af-fd8b-443d-97aa-d7285c252e84 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.367292 Aug 05 19:55:30.051847 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 336/661] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:29 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:30.232385 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:30.252751 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:30.295541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:30.296799 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:30.297943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:30.300036 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:30.301654 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:30.303249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:30.393500 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:30.761892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:30.770368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6d0f2fc8-0a5a-4f2d-9342-883c490b1f28 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1691 microversion: 2.1 time: 0.547806 Aug 05 19:55:30.771430 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 326/662] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:30 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1691 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:31.073389 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:31.074002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:31.084154 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:31.084937 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:31.086701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:31.088031 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:31.088736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:31.089385 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:31.318863 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:31.328779 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9f63ac84-7da9-481b-869f-1ac90ebba37f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1363 microversion: 2.1 time: 0.260096 Aug 05 19:55:31.329372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 337/663] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:31 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:31.442815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-2926eeda-3d65-48db-aaf4-6997e7f2b439 req-9e3a0cb6-c028-4892-b9f7-d32df6fb9cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75eabf8-c187-4e38-afe7-c8f017f3a3f3", "name": "network-vif-deleted", "tag": "2fa04866-048e-4c7e-aa04-cbd556836f35"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:31.472738 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-2926eeda-3d65-48db-aaf4-6997e7f2b439 req-9e3a0cb6-c028-4892-b9f7-d32df6fb9cef service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:31.473452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-2926eeda-3d65-48db-aaf4-6997e7f2b439 req-9e3a0cb6-c028-4892-b9f7-d32df6fb9cef service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:31.474068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-2926eeda-3d65-48db-aaf4-6997e7f2b439 req-9e3a0cb6-c028-4892-b9f7-d32df6fb9cef service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:31.490939 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-2926eeda-3d65-48db-aaf4-6997e7f2b439 req-9e3a0cb6-c028-4892-b9f7-d32df6fb9cef service nova] Creating event network-vif-deleted:2fa04866-048e-4c7e-aa04-cbd556836f35 for instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 on hv-cinder-85220 Aug 05 19:55:31.518717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-2926eeda-3d65-48db-aaf4-6997e7f2b439 req-9e3a0cb6-c028-4892-b9f7-d32df6fb9cef service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.417862 Aug 05 19:55:31.523656 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 327/664] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:55:31.796339 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:31.797344 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:31.807010 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:31.807924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:31.808582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:31.809526 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:31.811023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:31.811700 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:31.914965 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:31.923883 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-417c9cdb-0623-4f86-ae7d-66c39c0d7e5b tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 200 len: 1331 microversion: 2.1 time: 0.135114 Aug 05 19:55:31.930684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 338/665] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:31 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:32.352389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:32.353565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:32.366351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:32.380851 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:32.381349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:32.383386 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:32.385836 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:32.388876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:32.681708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:32.690376 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c705ffd0-99f0-4b2f-935e-745846544ffb tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1548 microversion: 2.1 time: 0.343430 Aug 05 19:55:32.699086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 328/666] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:32 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1548 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:32.724077 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:32.725283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:32.736265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:32.736766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:32.737205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:32.737915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:32.740717 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:32.741187 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:32.863714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-cb50bf1d-2e60-4b92-a874-89ae573f84d6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144442 Aug 05 19:55:32.865513 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 339/667] 10.222.0.86 () {58 vars in 1275 bytes} [Fri Aug 5 19:55:32 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:32.955259 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:32.956182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: e75eabf8-c187-4e38-afe7-c8f017f3a3f3] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:32.970098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:32.970953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:32.972346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:32.973473 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:32.974112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:32.974760 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:33.001092 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] HTTP exception thrown: Instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 could not be found. Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Request method failure captured: Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 HTTP/1.1 Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRoBp7v2JhjAzgVq1cWsYiA0mH9TZlZoUjqM4s3bbCY4VzEGYMq8T6pPBvK77eXO7ywOgkhRmCAZgAIFq7kt4N1tU6o_U5KnIjXcbPNn0aeYnrrGb5UNkx50nMwoJoHd4BAsufzPPDT2agJBFtcA6nesUSm5FI09tcwFD4V2eRvHLA Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:55:33.003315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}] Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: d183fcdae86448caa81c09823dd3884e Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 could not be found. Aug 05 19:55:33.005009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'e75eabf8-c187-4e38-afe7-c8f017f3a3f3'} Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 could not be found. Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:55:33.005941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 could not be found. Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 could not be found. Aug 05 19:55:33.008032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:33.011185 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Returning 404 to user: Instance e75eabf8-c187-4e38-afe7-c8f017f3a3f3 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:55:33.012446 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4caeee4b-b3e2-4fa2-a6a7-6aef46602429 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3" status: 404 len: 111 microversion: 2.1 time: 0.067638 Aug 05 19:55:33.017133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 329/668] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:32 2022] GET /compute/v2.1/servers/e75eabf8-c187-4e38-afe7-c8f017f3a3f3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:55:33.021845 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d0efcbb4-3dc8-43e0-bb3f-82d6519accd4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '.version_select at 0x7f18c80e6dc0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:33.060186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d0efcbb4-3dc8-43e0-bb3f-82d6519accd4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029107281" status: 202 len: 0 microversion: 2.1 time: 0.042129 Aug 05 19:55:33.064274 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 340/669] 10.222.0.86 () {58 vars in 1221 bytes} [Fri Aug 5 19:55:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029107281 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:55:35.033534 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-dfe45d0c-ec64-4208-82ba-8eb4790f4ba1 req-af9a3314-3a05-452b-8f84-c16146a76280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6", "tag": "f7c6c3d7-c542-4392-baac-c0cb1d1a7ee6"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:35.063368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-dfe45d0c-ec64-4208-82ba-8eb4790f4ba1 req-af9a3314-3a05-452b-8f84-c16146a76280 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:35.064089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-dfe45d0c-ec64-4208-82ba-8eb4790f4ba1 req-af9a3314-3a05-452b-8f84-c16146a76280 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:35.064642 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-dfe45d0c-ec64-4208-82ba-8eb4790f4ba1 req-af9a3314-3a05-452b-8f84-c16146a76280 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:35.088811 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-dfe45d0c-ec64-4208-82ba-8eb4790f4ba1 req-af9a3314-3a05-452b-8f84-c16146a76280 service nova] Creating event network-changed:f7c6c3d7-c542-4392-baac-c0cb1d1a7ee6 for instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 on hv-cinder-85220 Aug 05 19:55:35.096206 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-dfe45d0c-ec64-4208-82ba-8eb4790f4ba1 req-af9a3314-3a05-452b-8f84-c16146a76280 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072932 Aug 05 19:55:35.104113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 330/670] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:37.108937 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:37.109587 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:37.116014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:37.116850 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:37.117370 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:37.118260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:37.118742 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:37.119227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:37.149015 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Going to try to terminate instance {{(pid=124553) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:55:37.264712 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-205878a2-cbf1-47c3-852f-409b64fa111e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "DELETE /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 204 len: 0 microversion: 2.1 time: 0.159614 Aug 05 19:55:37.265965 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 341/671] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:55:37 2022] DELETE /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:55:37.277786 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:37.279981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:37.294681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:37.295709 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:37.296327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:37.297295 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:37.297763 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:37.298198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:37.473760 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:37.489321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4f4b338c-3efc-406c-9221-dc4d35b3a388 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1508 microversion: 2.1 time: 0.216805 Aug 05 19:55:37.489954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 331/672] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:37 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:38.518800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:38.519509 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:38.526359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:38.526882 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:38.527324 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:38.528030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:38.528488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:38.529446 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:38.682532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:38.691060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-813c393e-0360-4c32-b804-75761abfccd5 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1508 microversion: 2.1 time: 0.176382 Aug 05 19:55:38.691657 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 342/673] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:38 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:38.996454 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:38.997005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:39.003454 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:39.004318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:39.005254 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:39.012967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:39.013478 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:39.013923 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:39.042576 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e778fa7f-731d-4cf6-86a3-7dab5b4f904a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/ips" status: 200 len: 148 microversion: 2.1 time: 0.177005 Aug 05 19:55:39.046659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 332/674] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:55:38 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/ips => generated 148 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:39.715032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:39.715812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:39.728304 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:39.729027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:39.729657 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:39.730537 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:39.731337 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:39.731994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:39.902778 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:39.911483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6b4f2be9-3d25-4a4e-89a7-d2b4a53220c2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1508 microversion: 2.1 time: 0.201578 Aug 05 19:55:39.912447 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 343/675] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:39 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:40.470164 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f04599f0-8127-4655-9753-e9dde47c2896"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:40.482858 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:40.490261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:40.499820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:40.506693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:40.512632 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:40.513483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:40.516907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:40.880702 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-a0aa3541-0a86-4f2c-bbe0-7a17b794e21a req-2e95f0e9-0f90-43ca-a71c-b623b055321e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8b5fc0-602e-4268-87ad-27dcff3c7a15", "name": "network-vif-deleted", "tag": "82d15027-863b-4373-8830-ede32d2c1d2c"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:40.899289 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f0f81c4d-881d-40b3-8629-0fdbdb4fdb1e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436182 Aug 05 19:55:40.907121 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-a0aa3541-0a86-4f2c-bbe0-7a17b794e21a req-2e95f0e9-0f90-43ca-a71c-b623b055321e service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:40.908125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-a0aa3541-0a86-4f2c-bbe0-7a17b794e21a req-2e95f0e9-0f90-43ca-a71c-b623b055321e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:40.910940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-a0aa3541-0a86-4f2c-bbe0-7a17b794e21a req-2e95f0e9-0f90-43ca-a71c-b623b055321e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:40.916332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 333/676] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:55:40 2022] POST /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:40.935207 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:40.941515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:40.947285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-a0aa3541-0a86-4f2c-bbe0-7a17b794e21a req-2e95f0e9-0f90-43ca-a71c-b623b055321e service nova] Creating event network-vif-deleted:82d15027-863b-4373-8830-ede32d2c1d2c for instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 on hv-cinder-85220 Aug 05 19:55:40.958126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-a0aa3541-0a86-4f2c-bbe0-7a17b794e21a req-2e95f0e9-0f90-43ca-a71c-b623b055321e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086002 Aug 05 19:55:40.959320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 344/677] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:40.971308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:40.977187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:40.977499 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:40.978728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:40.983118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:40.983878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:41.124779 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:41.156093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-82877bd3-06a8-40e2-951c-a91f29007bab tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 200 len: 1293 microversion: 2.1 time: 0.225338 Aug 05 19:55:41.161836 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 334/678] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:40 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 1293 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:42.184249 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:42.184925 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: bc8b5fc0-602e-4268-87ad-27dcff3c7a15] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:42.191655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:42.192156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:42.192600 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:42.193319 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:42.193778 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:42.194205 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:42.209467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] HTTP exception thrown: Instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 could not be found. Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Request method failure captured: Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 HTTP/1.1 Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRoBp7v2JhjAzgVq1cWsYiA0mH9TZlZoUjqM4s3bbCY4VzEGYMq8T6pPBvK77eXO7ywOgkhRmCAZgAIFq7kt4N1tU6o_U5KnIjXcbPNn0aeYnrrGb5UNkx50nMwoJoHd4BAsufzPPDT2agJBFtcA6nesUSm5FI09tcwFD4V2eRvHLA Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:55:42.211237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}] Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: d183fcdae86448caa81c09823dd3884e Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 could not be found. Aug 05 19:55:42.212580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'bc8b5fc0-602e-4268-87ad-27dcff3c7a15'} Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 could not be found. Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:55:42.213310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 could not be found. Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 could not be found. Aug 05 19:55:42.214455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:55:42.215564 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Returning 404 to user: Instance bc8b5fc0-602e-4268-87ad-27dcff3c7a15 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:55:42.215564 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-99b36f3c-c95e-4d93-bec0-31eb8905453c tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15" status: 404 len: 111 microversion: 2.1 time: 0.034801 Aug 05 19:55:42.215564 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 345/679] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:42 2022] GET /compute/v2.1/servers/bc8b5fc0-602e-4268-87ad-27dcff3c7a15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:55:42.224392 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:42.225877 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:42.228613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:42.235361 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:42.236000 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:42.236518 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:42.237315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:42.237868 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:42.238370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:42.270581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:55:42.370393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6fcdc19b-bf7c-4885-b8e2-04c08a29bbf1 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "DELETE /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 204 len: 0 microversion: 2.1 time: 0.149796 Aug 05 19:55:42.371498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 335/680] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:55:42 2022] DELETE /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:55:42.384867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:42.384867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:42.391191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:42.392123 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:42.392895 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:42.394657 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:42.395574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:42.396358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:42.572462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:42.580509 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7a9d6942-adc6-4800-a59c-e2bc149188da tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.203713 Aug 05 19:55:42.594512 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 346/681] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:42 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:43.003769 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-808a3b80-71e1-4816-a782-e5f17bac7fd9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Action: 'create', calling method: .version_select at 0x7f18c3745ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1145436541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4r9rbjpxt3T7rWM3DHSHt9ffd5V7N6L+830jqR2XA8xquw/Ytfi391Bly6mCKww13tKrpDwAS3PaoVetansLaerWm2J4YkKuxASt8PlAa5Ro8WUJNmQEIgUGrkDedB4Q=="}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:43.020551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-808a3b80-71e1-4816-a782-e5f17bac7fd9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Getting quotas for project c492b732353043b3bfe7c77daad9df4c. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:55:43.025472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-808a3b80-71e1-4816-a782-e5f17bac7fd9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Getting quotas for user 48caa6935f9a45b994460b9cb40a4dcf and project c492b732353043b3bfe7c77daad9df4c. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:55:43.058558 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-808a3b80-71e1-4816-a782-e5f17bac7fd9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056645 Aug 05 19:55:43.058558 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 336/682] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:55:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:43.113733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1435322773", "imageRef": "800ed98f-a3e3-44f9-b916-94636b0f5283", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1145436541", "networks": [{"uuid": "4af2b308-eb18-4f39-9503-894d5ddd24ec"}]}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:43.179305 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] validate_networks() for [('4af2b308-eb18-4f39-9503-894d5ddd24ec', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:55:43.601453 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:43.602198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:43.610088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:43.610088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:43.610443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:43.611237 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:43.611858 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:43.611980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:55:43.612371 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:43.612472 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:55:43.613081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:55:43.613490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:55:43.613904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:55:43.625096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:43.625574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:43.626002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:43.626747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:43.627196 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:43.627613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:43.635285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:43.649611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Getting quotas for project c492b732353043b3bfe7c77daad9df4c. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:55:43.654009 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Getting quotas for user 48caa6935f9a45b994460b9cb40a4dcf and project c492b732353043b3bfe7c77daad9df4c. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:55:43.665741 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:55:43.668010 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800ed98f-a3e3-44f9-b916-94636b0f5283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:55:43.715883 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-170852a0-1d87-4df3-a9be-94f6f4e6e40c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609171 Aug 05 19:55:43.716676 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 347/683] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:55:43.727483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3c6fec8d-baa6-41ca-8fa6-dec8e0b7f234 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:43.728110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3c6fec8d-baa6-41ca-8fa6-dec8e0b7f234 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:43.770789 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:43.779039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-16d35018-5f38-4ce6-8aaa-bdce1e70be1e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.181479 Aug 05 19:55:43.779728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 337/684] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:43 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:43.782951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3c6fec8d-baa6-41ca-8fa6-dec8e0b7f234 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:43.790865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3c6fec8d-baa6-41ca-8fa6-dec8e0b7f234 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1259 microversion: 2.1 time: 0.067325 Aug 05 19:55:43.791441 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 348/685] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:43 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:44.800252 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:44.801070 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:44.808640 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:44.809193 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:44.809633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:44.810398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:44.810879 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:44.811307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:44.813268 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:44.813925 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:44.816262 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:44.823052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:44.823554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:44.823999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:44.824710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:44.825166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:44.825598 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:44.889783 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:44.897249 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fa736928-59ec-4778-b9c5-324e147ca9de tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1263 microversion: 2.1 time: 0.088097 Aug 05 19:55:44.901064 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 349/686] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:44 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:44.942497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:44.950988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-86b5d7d7-72d4-4198-b751-a15daf341b4a tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.154615 Aug 05 19:55:44.951558 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 338/687] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:44 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:45.919777 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:45.920386 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:45.926678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:45.927169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:45.928131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:45.928834 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:45.929335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:45.929956 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:45.972873 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:45.974538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:45.983348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:45.984497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:45.985535 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:45.986969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:45.987705 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:45.988581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:46.075649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:46.087590 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-27c475c2-d0f1-4741-9378-7e0b4789d574 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1311 microversion: 2.1 time: 0.171437 Aug 05 19:55:46.089046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 350/688] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:45 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1311 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:46.596287 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:46.604403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-419f0152-effc-4d83-b02a-39884574bd84 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1522 microversion: 2.1 time: 0.635365 Aug 05 19:55:46.605084 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 339/689] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:45 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:47.103374 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-2c4299e3-901d-4f56-ab40-38fb42313255 req-3090c9a5-7602-4164-96f7-d10ec8a23fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaad333-e443-4c16-8560-ba79a6b1881d", "name": "network-vif-deleted", "tag": "bf67316f-5b2f-43b1-9d3a-337a9abda2b3"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:47.110254 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:47.111630 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:47.118059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-2c4299e3-901d-4f56-ab40-38fb42313255 req-3090c9a5-7602-4164-96f7-d10ec8a23fbf service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:47.118857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-2c4299e3-901d-4f56-ab40-38fb42313255 req-3090c9a5-7602-4164-96f7-d10ec8a23fbf service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:47.119499 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-2c4299e3-901d-4f56-ab40-38fb42313255 req-3090c9a5-7602-4164-96f7-d10ec8a23fbf service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:47.122949 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:47.123443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:47.123893 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:47.124613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:47.125076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:47.125509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:47.131761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-2c4299e3-901d-4f56-ab40-38fb42313255 req-3090c9a5-7602-4164-96f7-d10ec8a23fbf service nova] Creating event network-vif-deleted:bf67316f-5b2f-43b1-9d3a-337a9abda2b3 for instance 6aaad333-e443-4c16-8560-ba79a6b1881d on hv-cinder-85220 Aug 05 19:55:47.138260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-2c4299e3-901d-4f56-ab40-38fb42313255 req-3090c9a5-7602-4164-96f7-d10ec8a23fbf service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038470 Aug 05 19:55:47.139601 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 351/690] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:47.233861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:47.243274 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e7e869f1-94ef-45a0-bda0-5c3518c0bf27 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1317 microversion: 2.1 time: 0.137629 Aug 05 19:55:47.244333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 340/691] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:47 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:47.643651 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:47.645159 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:47.652007 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:47.652521 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:47.652948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:47.653662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:47.654299 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:47.654917 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:47.735891 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:47.766683 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c14ac8cb-16e4-45a2-b971-13a39415f2a8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1480 microversion: 2.1 time: 0.127414 Aug 05 19:55:47.767843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 352/692] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:47 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1480 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:48.266650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:48.267694 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:48.276256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:48.276746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:48.277190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:48.277894 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:48.278377 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:48.278890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:48.446785 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:48.454875 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-66c290e0-9969-487b-8053-e003a061e150 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.193597 Aug 05 19:55:48.455440 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 341/693] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:48 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:48.788672 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:48.789905 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:48.797347 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:48.797841 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:48.798284 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:48.799017 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:48.799479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:48.799907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:48.869689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:48.877914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-525cb90e-1823-47b5-9fcc-f84ad0039df8 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1480 microversion: 2.1 time: 0.093429 Aug 05 19:55:48.878500 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 353/694] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:48 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1480 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:49.483644 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:49.483644 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:49.490638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:49.491931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:49.492662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:49.493479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:49.493937 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:49.494372 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:49.671516 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:49.680342 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-506829c7-6a64-4216-a4b5-3123d8f36364 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.207692 Aug 05 19:55:49.680929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 342/695] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:49 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:49.902040 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:49.902697 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:49.911274 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:49.911973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:49.912628 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:49.914057 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:49.914936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:49.915589 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:50.014064 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:50.025886 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a205232b-4486-43a7-81c2-6c8a6aa20854 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1480 microversion: 2.1 time: 0.128102 Aug 05 19:55:50.026933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 354/696] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:49 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1480 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:50.263106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:50.263716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:50.273335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:50.274068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:50.274596 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:50.275547 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:50.276011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:50.276599 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:50.292353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:50.306121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-22b22921-688c-491f-b2dc-6fae6a8e9b2a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/ips" status: 200 len: 151 microversion: 2.20 time: 0.048095 Aug 05 19:55:50.306749 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 343/697] 10.222.0.86 () {60 vars in 1289 bytes} [Fri Aug 5 19:55:50 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:55:50.704432 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:50.705492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:50.717428 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:50.718588 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:50.719495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:50.720705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:50.721514 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:50.722173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:50.888805 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:50.898792 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-59c1b325-9f9d-4684-88b4-7a7c3f5a4d53 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.198990 Aug 05 19:55:50.899400 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 355/698] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:50 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:51.048515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:51.049154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:51.056848 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:51.057331 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:51.057776 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:51.058494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:51.058985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:51.059420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:51.126190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:51.136961 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-93963c09-7b75-4bae-8fce-41ea5291b89d tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1480 microversion: 2.1 time: 0.092684 Aug 05 19:55:51.137767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 344/699] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:51 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1480 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:51.920027 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:51.920750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:51.928300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:51.929293 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:51.929740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:51.930500 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:51.930982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:51.931411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:52.071886 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:52.083645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-bd8dadda-52ab-4fa5-a172-84e94d5ff0cc tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.167463 Aug 05 19:55:52.084333 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 356/700] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:51 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:52.157699 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:52.158943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:52.167925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:52.168456 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:52.168893 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:52.169809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:52.170423 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:52.171162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:52.248956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:52.263882 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a06bcf65-0461-4101-9322-80d6f618a412 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1480 microversion: 2.1 time: 0.109424 Aug 05 19:55:52.264973 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 345/701] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:52 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1480 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:52.610684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:52.611248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:52.618896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:52.619491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:52.620008 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:52.620794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:52.621326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:52.621844 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:52.647277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lazy-loading 'flavor' on Instance uuid cca9826c-1788-4efe-951b-1092fead7ea9 {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:55:52.844642 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-11ff683f-30be-4b33-bdb7-7d019d3cf57a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/action" status: 202 len: 0 microversion: 2.20 time: 0.238211 Aug 05 19:55:52.845437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 357/702] 10.222.0.86 () {62 vars in 1319 bytes} [Fri Aug 5 19:55:52 2022] POST /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:55:52.854014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:52.855047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:52.862232 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:52.862979 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:52.863595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:52.864458 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:52.865068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:52.865647 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:53.032050 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:53.034248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=4 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:53.042322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:53.043897 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:53.045115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f9fb40f1-77ed-46ff-81a9-74fb3b1013b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.195403 Aug 05 19:55:53.046265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 346/703] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:55:52 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:55:53.106842 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:53.107547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:53.114412 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:53.114861 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:53.115299 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:53.116043 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:53.116713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:53.117322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:53.287501 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:53.288844 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:53.289005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:53.296319 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c7f32702-f0a0-4147-97c7-695697de21af tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.194366 Aug 05 19:55:53.296903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 358/704] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:53 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:53.297128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:53.297738 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:53.298183 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:53.298932 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:53.299577 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:53.300011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:53.367557 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:53.377163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ba456868-2987-47d0-85d4-b6964fbf07f2 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1480 microversion: 2.1 time: 0.093904 Aug 05 19:55:53.377772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 347/705] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:53 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1480 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:54.070232 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:54.071005 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:54.076864 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:54.077601 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=8 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:54.079080 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:54.090071 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:54.090071 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:54.090071 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:54.090071 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:54.090579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:54.243120 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:54.251863 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:54.253373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:54.254556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-32b4a0b1-f1a1-403a-9dcf-836dd8cdc06d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.189090 Aug 05 19:55:54.255143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 359/706] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:55:54 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:55:54.322475 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:54.323188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:54.329163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:54.329647 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:54.330079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:54.330869 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:54.331286 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:54.331705 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:54.400503 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:54.401121 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:54.407702 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:54.408477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:54.409110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:54.409814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:54.410265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:54.410707 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:54.493082 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:54.501571 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-997e0968-c9dc-4e73-9f80-7880daf47a29 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1480 microversion: 2.1 time: 0.106503 Aug 05 19:55:54.515713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 360/707] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:54 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1480 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:54.521207 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:54.531110 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c7fe1e06-e2d5-49fa-a5c8-9e35e374097c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.216712 Aug 05 19:55:54.532326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 348/708] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:54 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:55.279188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:55.279812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:55.286304 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:55.286830 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:55.287266 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:55.288106 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:55.288724 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:55.289199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:55.457618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:55.466878 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:55.468421 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:55.469581 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a020bf32-c5fb-492b-bbdb-5b5a90276a90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.194319 Aug 05 19:55:55.470140 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 361/709] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:55:55 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:55:55.526242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:55.527212 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:55.534090 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:55.534513 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:55.534978 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:55.535693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:55.536151 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:55.536580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:55.554977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:55.555601 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:55.561610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:55.562363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:55.562829 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:55.563539 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:55.563992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:55.564699 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:55.630939 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:55.639600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-35b72edd-2f04-47af-ab2d-81e8014dc9a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1306 microversion: 2.1 time: 0.117990 Aug 05 19:55:55.640277 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 349/710] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:55 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1306 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:55.704845 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:55.714012 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c5e3e12e-af9d-441f-8e8d-fcdb30d10230 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.164311 Aug 05 19:55:55.714817 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 362/711] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:55 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:56.039441 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-13c68832-5909-4c05-ac85-dc3b91ae061a req-220daa5a-d9b8-4a82-a85d-30cd1c587190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec295b92-6466-4366-ba60-1e1d50beb9d6", "tag": "34a60c93-aacf-4bba-8c03-257ef4588a08"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:56.049950 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-13c68832-5909-4c05-ac85-dc3b91ae061a req-220daa5a-d9b8-4a82-a85d-30cd1c587190 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:56.050504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-13c68832-5909-4c05-ac85-dc3b91ae061a req-220daa5a-d9b8-4a82-a85d-30cd1c587190 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:56.050986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-13c68832-5909-4c05-ac85-dc3b91ae061a req-220daa5a-d9b8-4a82-a85d-30cd1c587190 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:56.065424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-13c68832-5909-4c05-ac85-dc3b91ae061a req-220daa5a-d9b8-4a82-a85d-30cd1c587190 service nova] Creating event network-changed:34a60c93-aacf-4bba-8c03-257ef4588a08 for instance ec295b92-6466-4366-ba60-1e1d50beb9d6 on hv-cinder-85220 Aug 05 19:55:56.071868 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-13c68832-5909-4c05-ac85-dc3b91ae061a req-220daa5a-d9b8-4a82-a85d-30cd1c587190 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038409 Aug 05 19:55:56.072943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 350/712] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:55:56.494444 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:56.495200 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:56.507358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:56.508130 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:56.508822 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:56.509714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:56.510465 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:56.510940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:56.661026 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:56.669394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:56.670329 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:56.670542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:56.671996 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:56.673174 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b489aa51-b77c-465d-bf13-8a5412a938e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.183496 Aug 05 19:55:56.673918 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 363/713] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:55:56 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:55:56.680329 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:56.680882 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:56.681458 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:56.682358 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:56.682978 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:56.683624 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:56.735285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:56.735773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:56.743081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:56.744259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:56.744858 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:56.745785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:56.747363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:56.748136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:56.750443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:56.750967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:56.751401 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:56.751924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lazy-loading 'fault' on Instance uuid 6aaad333-e443-4c16-8560-ba79a6b1881d {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:55:56.753689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:56.938826 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd183fcdae86448caa81c09823dd3884e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afed1554d1394cfc8abea0e6c5e15b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:56.948085 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:56.948475 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c4a4474c-318a-4581-8f19-8a06c1b3f2a4 tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 200 len: 1311 microversion: 2.1 time: 0.286773 Aug 05 19:55:56.962132 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 351/714] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:56 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 1311 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:56.962375 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-36d5305d-35f6-468b-a53e-43ad8aff0d11 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.225608 Aug 05 19:55:56.972677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 364/715] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:56 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:57.234730 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f04599f0-8127-4655-9753-e9dde47c2896"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:57.237186 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:57.244234 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.244732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.245171 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.245879 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.246334 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.246804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.335488 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Invalid volume: volume f04599f0-8127-4655-9753-e9dde47c2896 is already attached to instances: acffbb62-5c10-4d55-ad26-3e31f8ade0e6 Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: POST /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments HTTP/1.1 Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 74 Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:55:57.337258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {"volumeAttachment": {"volumeId": "f04599f0-8127-4655-9753-e9dde47c2896"}} Aug 05 19:55:57.338724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Invalid volume: volume f04599f0-8127-4655-9753-e9dde47c2896 is already attached to instances: acffbb62-5c10-4d55-ad26-3e31f8ade0e6 Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'server_id': 'acffbb62-5c10-4d55-ad26-3e31f8ade0e6', 'body': {'volumeAttachment': {'volumeId': 'f04599f0-8127-4655-9753-e9dde47c2896'}}} Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f04599f0-8127-4655-9753-e9dde47c2896 is already attached to instances: acffbb62-5c10-4d55-ad26-3e31f8ade0e6 Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:57.339483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f04599f0-8127-4655-9753-e9dde47c2896 is already attached to instances: acffbb62-5c10-4d55-ad26-3e31f8ade0e6 Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:57.340820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:57.342039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:57.342039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:55:57.342039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:55:57.342039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f04599f0-8127-4655-9753-e9dde47c2896 is already attached to instances: acffbb62-5c10-4d55-ad26-3e31f8ade0e6 Aug 05 19:55:57.342039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:57.342039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 400 to user: Invalid volume: volume f04599f0-8127-4655-9753-e9dde47c2896 is already attached to instances: acffbb62-5c10-4d55-ad26-3e31f8ade0e6 {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:55:57.342039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-409004ab-4b62-4c99-b005-8df45d6b30b6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108215 Aug 05 19:55:57.342039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 352/716] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:55:57 2022] POST /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 19:55:57.407722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:57.408689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:57.417450 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.418041 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.418548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.419348 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.419888 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.420369 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.512259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lazy-loading 'services' on Instance uuid acffbb62-5c10-4d55-ad26-3e31f8ade0e6 {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:55:57.641021 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-495b092b-2cd6-422a-b92e-e6a3916eda0d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments/f04599f0-8127-4655-9753-e9dde47c2896" status: 202 len: 0 microversion: 2.1 time: 0.237388 Aug 05 19:55:57.641620 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 365/717] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:55:57 2022] DELETE /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments/f04599f0-8127-4655-9753-e9dde47c2896 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:55:57.650619 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:57.652993 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:57.658919 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.659403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.659841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.660532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.660982 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.661405 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.692484 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-42926a1b-114c-4832-ac5f-48dad5fb764c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046438 Aug 05 19:55:57.693160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 353/718] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:55:57 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:57.707212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:57.707926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:57.715238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.715724 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.716158 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.716854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.717356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.717812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.859602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:57.868814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:57.870316 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:57.871515 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-29243472-20ed-4d4b-be32-b4194ebf363c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.168738 Aug 05 19:55:57.872079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 366/719] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:55:57 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:55:57.969729 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:57.970247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] [instance: 6aaad333-e443-4c16-8560-ba79a6b1881d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:57.977473 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.977956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.978394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.979121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.979569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.979992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.982366 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:57.983026 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:57.988944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.989429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.989866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.990560 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:57.991836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:57.992356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:57.994497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] HTTP exception thrown: Instance 6aaad333-e443-4c16-8560-ba79a6b1881d could not be found. Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Request method failure captured: Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d HTTP/1.1 Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRoBp7v2JhjAzgVq1cWsYiA0mH9TZlZoUjqM4s3bbCY4VzEGYMq8T6pPBvK77eXO7ywOgkhRmCAZgAIFq7kt4N1tU6o_U5KnIjXcbPNn0aeYnrrGb5UNkx50nMwoJoHd4BAsufzPPDT2agJBFtcA6nesUSm5FI09tcwFD4V2eRvHLA Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:55:57.996343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_afed1554d1394cfc8abea0e6c5e15b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/afed1554d1394cfc8abea0e6c5e15b3f"}]}] Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: afed1554d1394cfc8abea0e6c5e15b3f Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-216370147 Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: d183fcdae86448caa81c09823dd3884e Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-216370147-project Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 6aaad333-e443-4c16-8560-ba79a6b1881d could not be found. Aug 05 19:55:57.999389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '6aaad333-e443-4c16-8560-ba79a6b1881d'} Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aaad333-e443-4c16-8560-ba79a6b1881d could not be found. Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:55:58.000725 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aaad333-e443-4c16-8560-ba79a6b1881d could not be found. Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aaad333-e443-4c16-8560-ba79a6b1881d could not be found. Aug 05 19:55:58.005595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:55:58.010262 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] Returning 404 to user: Instance 6aaad333-e443-4c16-8560-ba79a6b1881d could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:55:58.010262 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7984fa3c-7a17-479e-ab73-f10876fea83e tempest-ServerRescueNegativeTestJSON-216370147 tempest-ServerRescueNegativeTestJSON-216370147-project] 10.222.0.86 "GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d" status: 404 len: 111 microversion: 2.1 time: 0.031981 Aug 05 19:55:58.010262 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 354/720] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:57 2022] GET /compute/v2.1/servers/6aaad333-e443-4c16-8560-ba79a6b1881d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:55:58.138379 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:58.146885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d53d1705-a6b0-4b84-9b7c-a75cc7d59d3a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.169082 Aug 05 19:55:58.148213 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 367/721] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:57 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:58.706229 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:58.708559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:58.715378 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:58.716070 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:58.716514 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:58.717228 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:58.717683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:58.718109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:58.749054 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dbf08710-f6ea-4a07-a8a2-b08e37ff5f4d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Aug 05 19:55:58.749659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 355/722] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:55:58 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:55:58.895314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:58.895953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:58.903089 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:58.903583 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:58.904015 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:58.904720 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:58.905168 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:58.905594 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:59.114267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:59.124905 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:59.126452 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:59.127661 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a0148e90-ad7f-47ef-8f9f-bb1cf09dc398 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.236391 Aug 05 19:55:59.128216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 368/723] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:55:58 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:55:59.172224 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:59.173729 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:59.185683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:59.186564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:59.187403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:59.188653 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:59.189477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:59.190820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:59.436449 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:55:59.444604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8e842828-c8be-4c54-bdf2-c8389be03946 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.279760 Aug 05 19:55:59.445630 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 356/724] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:55:59 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:59.761793 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:59.764349 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:59.770651 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:59.771173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:59.771612 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:59.772376 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:59.772831 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:59.773262 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:59.806992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-209e62ba-992c-40be-b4f3-e30b4e1dcbf5 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049218 Aug 05 19:55:59.807601 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 369/725] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:55:59 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:55:59.874003 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:59.874498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:55:59.884108 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:59.884983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:59.886797 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:59.888958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:59.888958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:59.889418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:59.917463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:56:00.024798 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-83f63d1a-0eea-4109-abf8-135db8c9ae99 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 204 len: 0 microversion: 2.1 time: 0.154285 Aug 05 19:56:00.025537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 357/726] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:55:59 2022] DELETE /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:56:00.033770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:00.034390 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:00.042032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:00.042558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:00.043371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:00.043826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:00.044277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:00.044706 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:00.170760 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:00.172372 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:00.182931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:00.184112 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:00.185172 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:00.186060 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:00.186982 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:00.187576 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:00.195618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:00.205229 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-67655773-7da2-4542-830e-3da8fb1bc520 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1678 microversion: 2.1 time: 0.174938 Aug 05 19:56:00.206448 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 370/727] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:00 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:00.430893 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:00.441256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:00.443440 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:00.447433 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7695aa71-4258-4009-912b-d7ff36529f36 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.281370 Aug 05 19:56:00.448027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 358/728] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:00 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:00.467173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:00.468053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:00.474193 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:00.474924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:00.480546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:00.481542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:00.482178 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:00.482800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:00.634548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:00.642358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ef5094d9-97a4-4230-823a-7298752a63a6 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.179017 Aug 05 19:56:00.642971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 371/729] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:00 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:01.229096 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:01.229703 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:01.236846 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:01.237341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:01.237839 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:01.238600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:01.239079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:01.239678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:01.472704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:01.473599 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:01.481730 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:01.482521 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:01.484463 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:01.485302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:01.485762 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:01.486340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:01.519048 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:01.521339 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:01.532590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6d4f76e5-663a-42fb-96ee-ac3bf1b34df8 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1678 microversion: 2.1 time: 0.308026 Aug 05 19:56:01.533271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 359/730] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:01 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1678 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:01.681583 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:01.681583 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:01.687644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:01.698300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:01.700835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:01.700994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:01.701571 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:01.702033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-cf76a370-514e-4a88-a0df-b46288221cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.234107 Aug 05 19:56:01.702248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:01.703275 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 372/731] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:01 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:01.707321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:01.708639 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:01.708868 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:02.107563 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:02.118712 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-34872829-2267-4001-bb2e-64736e59c767 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.458483 Aug 05 19:56:02.131125 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 360/732] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:01 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:02.563144 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:02.564306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:02.578476 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:02.579989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:02.582061 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:02.583729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:02.584857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:02.585842 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:02.726368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:02.727119 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:02.737538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:02.742446 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:02.743098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:02.743827 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:02.746790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:02.747242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:02.769062 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:02.778676 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dfcfee07-cdb6-40ee-a36e-c22a053d0fe9 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1678 microversion: 2.1 time: 0.228258 Aug 05 19:56:02.779244 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 373/733] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:02 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:03.146394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:03.149492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:03.156812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:03.157479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:03.158146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:03.159096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:03.159618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:03.160118 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:03.288068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:03.298139 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:03.307789 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:03.309408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d46f2010-3a53-4f69-a73d-7622299a8d07 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.587735 Aug 05 19:56:03.310092 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 361/734] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:02 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:03.391134 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:03.399780 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c5fcf4e4-0feb-49be-bcbc-6a49c9332e31 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.258193 Aug 05 19:56:03.400349 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 374/735] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:03 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:03.492985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-3cb06703-b227-406b-aabf-ca8c471561d6 req-fda62028-ac30-4717-b53e-6bec3b6467d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acffbb62-5c10-4d55-ad26-3e31f8ade0e6", "name": "network-vif-deleted", "tag": "89a6562f-7178-496c-870e-966a548a5192"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:03.511994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-3cb06703-b227-406b-aabf-ca8c471561d6 req-fda62028-ac30-4717-b53e-6bec3b6467d1 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:03.512980 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-3cb06703-b227-406b-aabf-ca8c471561d6 req-fda62028-ac30-4717-b53e-6bec3b6467d1 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:03.513699 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-3cb06703-b227-406b-aabf-ca8c471561d6 req-fda62028-ac30-4717-b53e-6bec3b6467d1 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:03.532688 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-3cb06703-b227-406b-aabf-ca8c471561d6 req-fda62028-ac30-4717-b53e-6bec3b6467d1 service nova] Creating event network-vif-deleted:89a6562f-7178-496c-870e-966a548a5192 for instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 on hv-cinder-85220 Aug 05 19:56:03.538107 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-3cb06703-b227-406b-aabf-ca8c471561d6 req-fda62028-ac30-4717-b53e-6bec3b6467d1 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057832 Aug 05 19:56:03.539105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 362/736] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:56:03.802327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:03.804332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:03.812526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:03.813516 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:03.814111 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:03.815044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:03.815801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:03.816552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:03.825403 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d17c75d7-1815-4e2d-84fc-aaf5bdcf91da tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Action: 'create', calling method: .version_select at 0x7f18c37833a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-820499533", "metadata": {"Type": "work"}}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:03.855632 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:03.856351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:03.856851 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:03.857447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lazy-loading 'fault' on Instance uuid acffbb62-5c10-4d55-ad26-3e31f8ade0e6 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:56:03.908203 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:03.919911 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-20fb9225-bbc6-4112-b76d-15b20d05fd31 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 200 len: 1330 microversion: 2.1 time: 0.123193 Aug 05 19:56:03.920875 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 363/737] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:03 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 1330 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:04.204078 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d17c75d7-1815-4e2d-84fc-aaf5bdcf91da tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.510448 Aug 05 19:56:04.204747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 375/738] 10.222.0.86 () {60 vars in 1156 bytes} [Fri Aug 5 19:56:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 512 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 19:56:04.220936 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a33f3ff2-5a74-406b-bd16-b7d007f7f2fd tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Calling method '.version_select at 0x7f18c3786af0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:04.290838 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a33f3ff2-5a74-406b-bd16-b7d007f7f2fd tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d" status: 200 len: 352 microversion: 2.1 time: 0.076010 Aug 05 19:56:04.293907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 364/739] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:56:04 2022] GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d => generated 352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:04.313713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-519293a9-b269-4737-82b0-00131b4fb03b req-dd1d8a86-6dde-4e17-bdb9-90557bb11631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec295b92-6466-4366-ba60-1e1d50beb9d6", "name": "network-vif-plugged", "status": "completed", "tag": "34a60c93-aacf-4bba-8c03-257ef4588a08"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:04.324796 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-519293a9-b269-4737-82b0-00131b4fb03b req-dd1d8a86-6dde-4e17-bdb9-90557bb11631 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:04.325270 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-519293a9-b269-4737-82b0-00131b4fb03b req-dd1d8a86-6dde-4e17-bdb9-90557bb11631 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:04.325697 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-519293a9-b269-4737-82b0-00131b4fb03b req-dd1d8a86-6dde-4e17-bdb9-90557bb11631 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:04.337988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-519293a9-b269-4737-82b0-00131b4fb03b req-dd1d8a86-6dde-4e17-bdb9-90557bb11631 service nova] Creating event network-vif-plugged:34a60c93-aacf-4bba-8c03-257ef4588a08 for instance ec295b92-6466-4366-ba60-1e1d50beb9d6 on hv-cinder-85220 Aug 05 19:56:04.341318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:04.343671 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-519293a9-b269-4737-82b0-00131b4fb03b req-dd1d8a86-6dde-4e17-bdb9-90557bb11631 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109909 Aug 05 19:56:04.343935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:04.344394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 376/740] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:04.351042 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:04.351746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:04.353398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:04.354663 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:04.355124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:04.355721 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:04.424135 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:04.425012 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:04.434286 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:04.434976 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:04.435482 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:04.436301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:04.437086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:04.437731 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:04.525265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:04.534539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:04.536177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:04.537591 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-bee274f5-2a76-4cad-b2f6-2578d88fd522 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.203625 Aug 05 19:56:04.539564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 365/741] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:04 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:04.625771 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:04.635319 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4d7ff920-a879-4e38-85d2-92ebfeef9f74 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.216059 Aug 05 19:56:04.636727 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 377/742] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:04 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:04.944613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:04.945243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:04.952184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:04.952675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:04.953117 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:04.953815 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:04.954359 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:04.954825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:04.970232 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 HTTP/1.1 Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:56:04.972912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:56:04.974391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'acffbb62-5c10-4d55-ad26-3e31f8ade0e6'} Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:04.976565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:56:04.977759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:04.979335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:04.979335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-44c33232-fce9-4c0d-b149-808681d1fec7 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 404 len: 111 microversion: 2.1 time: 0.034429 Aug 05 19:56:04.979335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 366/743] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:04 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 19:56:04.986703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3b02497c-6f92-4070-b81a-996f3bf4bf49 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '.version_select at 0x7f18c3783550>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:05.011000 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3b02497c-6f92-4070-b81a-996f3bf4bf49 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747806953" status: 202 len: 0 microversion: 2.1 time: 0.028450 Aug 05 19:56:05.011592 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 378/744] 10.222.0.86 () {58 vars in 1218 bytes} [Fri Aug 5 19:56:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747806953 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:56:05.306412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c118e3f4-9f86-4175-b0c9-2544b88e1242 tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Calling method '.version_select at 0x7f18c8112b80>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:05.358804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c118e3f4-9f86-4175-b0c9-2544b88e1242 tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d" status: 200 len: 353 microversion: 2.1 time: 0.056472 Aug 05 19:56:05.360299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 367/745] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:56:05 2022] GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:05.373679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-84b87bec-0cdd-4bb3-8beb-561091594ba5 tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Calling method '.version_select at 0x7f18c37cd700>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:05.434898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-84b87bec-0cdd-4bb3-8beb-561091594ba5 tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d" status: 200 len: 353 microversion: 2.1 time: 0.065337 Aug 05 19:56:05.435602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 379/746] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:56:05 2022] GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:05.454024 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7cc132d9-f47e-4810-a8e5-468efffe94ef tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Calling method '.version_select at 0x7f18c37453a0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:05.531123 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7cc132d9-f47e-4810-a8e5-468efffe94ef tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d" status: 202 len: 0 microversion: 2.1 time: 0.081411 Aug 05 19:56:05.532070 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 368/747] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:56:05 2022] DELETE /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:56:05.542216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3a452e47-a26c-4639-a040-33a4d130a2bd tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Calling method '.version_select at 0x7f18c37a9e50>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:05.564735 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:05.565327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:05.573372 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:05.574185 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:05.574650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:05.575386 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:05.575857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:05.576293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:05.610964 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3a452e47-a26c-4639-a040-33a4d130a2bd tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d" status: 200 len: 352 microversion: 2.1 time: 0.072778 Aug 05 19:56:05.612326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 380/748] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:56:05 2022] GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:05.660011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:05.660558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:05.667998 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:05.668486 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:05.669115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:05.669992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:05.670610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:05.671075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:05.821888 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:05.830500 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:05.831463 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:05.832086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:05.833283 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-94e3432b-472a-43d0-a119-d72b89af75f5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.272899 Aug 05 19:56:05.833844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 369/749] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:05 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:05.839437 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-20db82b2-8c4d-485b-942d-545f4394267c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: .version_select at 0x7f18c3786670>, body: {"keypair": {"name": "tempest-keypair-1917528476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhy9Rt8csiDi8wk7I/c+mnv467zKJp3OAMU+77Zq+IJGbE8W1zIb1+/nzTLy4Ti4OiKMdwdbhvTLlvBc4udYcFl/jhwL4mezn4jMDJCxQC1nHgpHKkvUX60Vz2rtRHo8Q=="}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:05.843608 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3e0cfb60-1a01-4b7f-a41d-5871870147c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1359 microversion: 2.1 time: 0.187714 Aug 05 19:56:05.844297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 381/750] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:05 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:05.855834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-20db82b2-8c4d-485b-942d-545f4394267c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:56:05.859606 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-20db82b2-8c4d-485b-942d-545f4394267c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for user a357a3d27e4e41adae1c56ee39ae5aa7 and project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:56:05.876213 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:05.885245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-20db82b2-8c4d-485b-942d-545f4394267c tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050313 Aug 05 19:56:05.885855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 370/751] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:56:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:06.625113 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0ae81872-9d4c-42b9-8ba7-1272fbea92de tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Calling method '.version_select at 0x7f18c376ec10>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:06.659310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-0ae81872-9d4c-42b9-8ba7-1272fbea92de tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] HTTP exception thrown: Volume 010e6911-bdc0-4f93-a463-b936d87ef09d could not be found. Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0ae81872-9d4c-42b9-8ba7-1272fbea92de tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Request method failure captured: Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d HTTP/1.1 Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XXTC4wWTOeHXPugqyRMEsrS_2XKf26rWlutfRKzcarRL2fQgFRPky-GbFJDY_tzIapIoR8KMZQuR08B9QNPBaGDe6EG6z3Fqyf6EcLypRRnDw8lxcAdPLYlaR0h4Z_yCzIOojyRIkdzKpC0Hvof8h1lcDovP_ANWWZv7h3aIHgrEa4 Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 618b229691bb4875b775d74261fefb1d Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesGetTestJSON-1522167011 Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:56:06.663495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/618b229691bb4875b775d74261fefb1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/618b229691bb4875b775d74261fefb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_618b229691bb4875b775d74261fefb1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/618b229691bb4875b775d74261fefb1d"}]}] Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesGetTestJSON-1522167011 Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 618b229691bb4875b775d74261fefb1d Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesGetTestJSON-1522167011 Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesGetTestJSON-1522167011-project Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 162f406f06ea460e9531bfc72b6121bc Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesGetTestJSON-1522167011-project Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Volume 010e6911-bdc0-4f93-a463-b936d87ef09d could not be found. Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '010e6911-bdc0-4f93-a463-b936d87ef09d'} Aug 05 19:56:06.665173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 010e6911-bdc0-4f93-a463-b936d87ef09d could not be found. (HTTP 404) (Request-ID: req-e686a291-200e-42d3-a29f-224c32f4101e) Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:06.666208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:56:06.669072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 010e6911-bdc0-4f93-a463-b936d87ef09d could not be found. Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 19:56:06.670679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 010e6911-bdc0-4f93-a463-b936d87ef09d could not be found. Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 010e6911-bdc0-4f93-a463-b936d87ef09d could not be found. Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0ae81872-9d4c-42b9-8ba7-1272fbea92de tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] Returning 404 to user: Volume 010e6911-bdc0-4f93-a463-b936d87ef09d could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0ae81872-9d4c-42b9-8ba7-1272fbea92de tempest-VolumesGetTestJSON-1522167011 tempest-VolumesGetTestJSON-1522167011-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d" status: 404 len: 109 microversion: 2.1 time: 0.044585 Aug 05 19:56:06.672711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 382/752] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:56:06 2022] GET /compute/v2.1/os-volumes/010e6911-bdc0-4f93-a463-b936d87ef09d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:56:06.864867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:06.865047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:06.866200 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:06.866420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:06.873294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:06.873785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:06.874224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:06.874977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:06.875434 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:06.875867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:06.888335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:06.890122 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:06.890567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:06.891313 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:06.892029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:06.895526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:07.034501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:07.051952 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-eeb4a416-4ab7-4442-b2c6-b86de2f15a9d tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1549 microversion: 2.1 time: 0.190285 Aug 05 19:56:07.053592 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 383/753] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:06 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:07.078207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:07.078611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:07.087120 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:07.087739 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:07.088833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:07.089789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:07.090320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:07.090872 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:07.168359 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:07.178559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:07.180274 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:07.181567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-12711858-a452-4133-8e27-4edb73353df8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.327950 Aug 05 19:56:07.182802 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 371/754] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:06 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:07.242208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:07.250265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-40c8e399-996e-49e1-9850-412a04a464ee tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1549 microversion: 2.1 time: 0.178596 Aug 05 19:56:07.251030 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 384/755] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:07 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:07.273150 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:07.279494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:07.280356 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Searching by: {'deleted': False, 'project_id': 'c492b732353043b3bfe7c77daad9df4c'} {{(pid=124552) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 19:56:07.288865 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:07.289358 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:07.289846 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:07.290583 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:07.291064 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:07.292106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:07.385039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.multi_cell_list [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124552) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 19:56:07.492867 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5cfe6209-5724-462f-a78a-95fe5aacdd2b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225023 Aug 05 19:56:07.499602 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 372/756] 10.222.0.86 () {58 vars in 1125 bytes} [Fri Aug 5 19:56:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:07.507857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:07.508435 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:07.514765 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:07.515257 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:07.515700 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:07.516442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:07.516895 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:07.517317 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:07.587246 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1331699680", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "959e8ab5-efdc-46d3-bf82-ceecf78a7830"}], "security_groups": [{"name": "tempest-securitygroup--1672758801"}], "key_name": "tempest-keypair-1917528476", "user_data": "}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:07.691215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:07.694821 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:07.701503 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5e535aab-b58b-4f19-89a7-659aa2ab59ea tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1549 microversion: 2.1 time: 0.199836 Aug 05 19:56:07.702330 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 385/757] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:07 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:07.712078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] validate_networks() for [('959e8ab5-efdc-46d3-bf82-ceecf78a7830', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:56:08.207926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:08.208641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:08.216221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:08.216721 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:08.217169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:08.218031 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:08.218494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:08.218958 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:08.416708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:08.425297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:08.427107 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:08.429139 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-709cf401-5870-4c2d-9e42-5de9802c19b1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.227758 Aug 05 19:56:08.429705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 386/758] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:08 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:08.445591 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:56:08.446244 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:56:08.446765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:56:08.447178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:56:08.447594 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:56:08.457231 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:08.457732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:08.458181 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:08.458946 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:08.459474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:08.459912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:08.480805 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:56:08.488857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Getting quotas for user a357a3d27e4e41adae1c56ee39ae5aa7 and project 7f9fbd8d38b743e9915a370d8f1d77c4. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:56:08.501841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:56:08.504162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:56:08.561090 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a60ee1b4-1ed0-40ba-88e5-e7efb360022e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.978798 Aug 05 19:56:08.561740 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 373/759] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:56:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 19:56:08.573218 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-54d49b02-7357-4996-a304-9827b1969981 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:08.574022 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-54d49b02-7357-4996-a304-9827b1969981 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:08.633756 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-54d49b02-7357-4996-a304-9827b1969981 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:08.643722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-54d49b02-7357-4996-a304-9827b1969981 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1242 microversion: 2.1 time: 0.074837 Aug 05 19:56:08.644575 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 387/760] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:08 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:09.454982 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:09.455581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:09.468992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:09.469812 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:09.470193 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:09.471078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:09.471601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:09.472042 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:09.557859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "351a7af7-d665-41f6-a569-fd212de79da0"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:09.563098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:09.573598 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:09.573929 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:09.574374 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:09.575557 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:09.575896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:09.576496 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:09.643028 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:09.662110 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:09.685037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:09.690006 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-63b0a3fe-5029-44c5-85ae-2ec65e48008b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.240353 Aug 05 19:56:09.690942 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 374/761] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:09 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:09.697162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:09.697782 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:09.706957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:09.708090 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:09.709979 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:09.711305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:09.712217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:09.715035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:09.872816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:09.890210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4e31737f-9362-4ad3-b508-ca133d0f45bc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1302 microversion: 2.1 time: 0.197906 Aug 05 19:56:09.891144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 375/762] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:09 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1302 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:10.024593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9b63518f-3c42-4f88-842e-f215831e3af5 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "POST /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473458 Aug 05 19:56:10.025560 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 388/763] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:56:09 2022] POST /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments => generated 194 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:56:10.716120 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:10.717351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:10.724034 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:10.724348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:10.725512 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:10.726512 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:10.727001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:10.727433 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:10.923426 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:10.926299 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:10.940006 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:10.940921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:10.943009 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:10.946067 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:10.947584 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:10.948325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:11.000075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:11.011915 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:11.014087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:11.015571 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-877ab17b-4894-485b-9f00-8b88cd5cdd0b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.303499 Aug 05 19:56:11.016613 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 376/764] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:10 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:11.165289 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:11.175816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-af32e4dd-cccc-4803-bb52-8fb30f456e3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1368 microversion: 2.1 time: 0.259159 Aug 05 19:56:11.177311 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 389/765] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:10 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:11.684752 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-72883639-6552-454b-bd07-565184ad34fb req-0bcbc560-3361-4104-b842-fe1dcbd0861a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280a9bf9-043d-4a47-8a35-f184de29c2b0", "tag": "30097b8f-4f15-4542-8438-fbe4d2dc888b"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:11.705347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-72883639-6552-454b-bd07-565184ad34fb req-0bcbc560-3361-4104-b842-fe1dcbd0861a service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:11.706046 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-72883639-6552-454b-bd07-565184ad34fb req-0bcbc560-3361-4104-b842-fe1dcbd0861a service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:11.706736 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-72883639-6552-454b-bd07-565184ad34fb req-0bcbc560-3361-4104-b842-fe1dcbd0861a service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:11.723673 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-72883639-6552-454b-bd07-565184ad34fb req-0bcbc560-3361-4104-b842-fe1dcbd0861a service nova] Creating event network-changed:30097b8f-4f15-4542-8438-fbe4d2dc888b for instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 on hv-cinder-85220 Aug 05 19:56:11.732081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-72883639-6552-454b-bd07-565184ad34fb req-0bcbc560-3361-4104-b842-fe1dcbd0861a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050037 Aug 05 19:56:11.733394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 377/766] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:11.890367 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:11.891018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:11.898428 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:11.899065 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:11.899739 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:11.900973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:11.901098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:11.901605 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:11.944569 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-407c3b9f-a5e0-41ab-8770-867f67777491 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/ips" status: 200 len: 144 microversion: 2.1 time: 0.057143 Aug 05 19:56:11.957679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 390/767] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:56:11 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/ips => generated 144 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:56:12.042828 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:12.044302 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:12.053850 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:12.055110 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:12.055678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:12.056569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:12.057493 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:12.058064 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:12.204601 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:12.205755 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:12.232348 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:12.233509 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:12.234525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:12.236813 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:12.237892 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:12.238960 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:12.527375 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:12.538336 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-722a697f-2174-48f7-ab21-7780950278fb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1368 microversion: 2.1 time: 0.341998 Aug 05 19:56:12.538946 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 391/768] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:12 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:12.701671 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:12.719691 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:12.721268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:12.722463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-71966775-4bbc-4b7f-a280-1ff6adff929b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.686299 Aug 05 19:56:12.723068 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 378/769] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:12 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:13.356455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4b44591-bd0f-4a0a-aaec-8cf66e7ff129"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:13.358989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:13.365403 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:13.366502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:13.367146 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:13.368256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:13.368880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:13.369468 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:13.566983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:13.568577 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:13.576717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:13.577645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:13.578250 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:13.579176 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:13.579796 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:13.580386 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:13.723887 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3ee3e350-ef51-405b-bc4e-bb44c8d21453 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371306 Aug 05 19:56:13.725479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 392/770] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:56:13 2022] POST /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:13.749835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:13.750738 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:13.770618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:13.770618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:13.770618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:13.770618 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:13.770992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:13.770992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:13.983696 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:13.992686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:13.994604 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:13.995882 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c9d841bb-1444-478d-978e-fe611c3b9e32 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.253106 Aug 05 19:56:13.996518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 393/771] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:13 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:14.035532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:14.046296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-69d35b30-9c09-424f-b9a8-57dfe9f07b18 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1368 microversion: 2.1 time: 0.483541 Aug 05 19:56:14.046923 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 379/772] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:13 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1368 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:15.019430 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:15.020056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:15.023544 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:15.029001 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:15.029631 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:15.030070 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:15.030831 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:15.031301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:15.031724 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:15.068049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:15.069497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:15.076297 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:15.077027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:15.077549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:15.078317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:15.080056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:15.080056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:15.183861 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:15.192187 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:15.194904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:15.196291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5b969460-9785-48ff-aa57-36b81a65695c tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.180703 Aug 05 19:56:15.196867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 394/773] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:15 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:15.241443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:15.249231 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-97426786-0b9e-4f30-b3ed-a5eca89b70af tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1368 microversion: 2.1 time: 0.185129 Aug 05 19:56:15.249927 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 380/774] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:15 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:16.220829 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:16.221643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:16.229491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:16.229941 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:16.230353 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:16.231080 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:16.231531 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:16.231951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:16.273246 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:16.274006 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:16.281785 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:16.282442 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:16.283028 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:16.284066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:16.284634 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:16.285128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:16.387668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:16.396948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:16.398491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:16.399723 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-55b853d8-1d2a-4d70-85a5-39e658e9882d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.184081 Aug 05 19:56:16.400288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 395/775] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:16 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:16.429301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:16.438776 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4252dc0e-2f1b-4756-8ac8-a98e798aa877 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1368 microversion: 2.1 time: 0.169991 Aug 05 19:56:16.439575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 381/776] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:16 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:17.425813 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:17.427152 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:17.435368 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:17.435896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:17.436370 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:17.437167 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:17.437655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:17.438124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:17.464861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:17.465480 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:17.479979 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:17.480631 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:17.481424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:17.482579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:17.483439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:17.484236 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:17.511933 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=100 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:17.659801 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:17.670443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9d36a0c6-1d49-43bb-bd98-301ad5d195f3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1368 microversion: 2.1 time: 0.213826 Aug 05 19:56:17.677128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 382/777] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:17 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:17.708115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:17.722891 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:17.726734 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:17.729210 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-aa3c2fdf-573a-45ce-8723-f25b37b092e5 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1744 microversion: 2.20 time: 0.306909 Aug 05 19:56:17.730222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 396/778] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:17 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1744 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:17.872237 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:17.872917 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:17.890581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:17.891696 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:17.892360 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:17.893246 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:17.893855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:17.894413 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:18.092298 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:18.112707 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-1fb55e05-b7d0-4607-bfcb-8b7c0b76ad88 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1595 microversion: 2.1 time: 0.253290 Aug 05 19:56:18.113296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 383/779] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:17 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1595 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:18.180491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-722f887b-b3f0-4f8e-af5b-907f53cb3643 req-c802bc5d-6d4d-4e05-8491-75f818ec58c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280a9bf9-043d-4a47-8a35-f184de29c2b0", "name": "network-vif-plugged", "status": "completed", "tag": "30097b8f-4f15-4542-8438-fbe4d2dc888b"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:18.206987 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-722f887b-b3f0-4f8e-af5b-907f53cb3643 req-c802bc5d-6d4d-4e05-8491-75f818ec58c0 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:18.207848 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-722f887b-b3f0-4f8e-af5b-907f53cb3643 req-c802bc5d-6d4d-4e05-8491-75f818ec58c0 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:18.208611 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-722f887b-b3f0-4f8e-af5b-907f53cb3643 req-c802bc5d-6d4d-4e05-8491-75f818ec58c0 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:18.236149 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-722f887b-b3f0-4f8e-af5b-907f53cb3643 req-c802bc5d-6d4d-4e05-8491-75f818ec58c0 service nova] Creating event network-vif-plugged:30097b8f-4f15-4542-8438-fbe4d2dc888b for instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 on hv-cinder-85220 Aug 05 19:56:18.251094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-722f887b-b3f0-4f8e-af5b-907f53cb3643 req-c802bc5d-6d4d-4e05-8491-75f818ec58c0 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076099 Aug 05 19:56:18.252880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 397/780] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:56:18.695840 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:18.696463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:18.698330 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=4 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:18.699471 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=10 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:18.706173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:18.706700 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:18.707286 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:18.711089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:18.711089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:18.711089 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:18.762296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:18.768186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:18.768989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:18.782373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:18.783216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:18.783660 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:18.784432 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:18.784876 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:18.785305 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:18.901281 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:18.910281 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0a44545a-3ea3-45c3-93aa-a85168ecc164 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1368 microversion: 2.1 time: 0.219579 Aug 05 19:56:18.910959 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 384/781] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:18 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:19.013843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:19.026363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:19.029308 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:19.030961 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7655ba19-208c-41cf-a5b5-c2e8dbbb13c3 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1744 microversion: 2.20 time: 0.269954 Aug 05 19:56:19.046959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 398/782] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:18 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1744 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:19.934722 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:19.935349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:19.947475 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:19.948355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:19.948981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:19.950901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:19.951682 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:19.952280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:20.055766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:20.057050 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:20.069464 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:20.070396 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:20.071199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:20.072448 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:20.073083 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:20.073826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:20.158500 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:20.166666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-da43eb08-1ac4-4094-9690-e61e55b4bcd4 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1368 microversion: 2.1 time: 0.236263 Aug 05 19:56:20.167295 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 385/783] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:19 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:20.290553 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:20.304551 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:20.308765 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:20.311163 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a23e749b-f543-49ca-ac09-ebc934e81cea tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.260587 Aug 05 19:56:20.314447 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 399/784] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:20 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:20.998251 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-fd9605d3-c535-489c-9335-9a0b30c5ecaa req-04e7892d-7836-4340-ac9e-de32be5b3ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec295b92-6466-4366-ba60-1e1d50beb9d6", "tag": "34a60c93-aacf-4bba-8c03-257ef4588a08"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:21.025532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-fd9605d3-c535-489c-9335-9a0b30c5ecaa req-04e7892d-7836-4340-ac9e-de32be5b3ad4 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:21.027133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-fd9605d3-c535-489c-9335-9a0b30c5ecaa req-04e7892d-7836-4340-ac9e-de32be5b3ad4 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:21.029751 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-fd9605d3-c535-489c-9335-9a0b30c5ecaa req-04e7892d-7836-4340-ac9e-de32be5b3ad4 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:21.064118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-fd9605d3-c535-489c-9335-9a0b30c5ecaa req-04e7892d-7836-4340-ac9e-de32be5b3ad4 service nova] Creating event network-changed:34a60c93-aacf-4bba-8c03-257ef4588a08 for instance ec295b92-6466-4366-ba60-1e1d50beb9d6 on hv-cinder-85220 Aug 05 19:56:21.075794 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-fd9605d3-c535-489c-9335-9a0b30c5ecaa req-04e7892d-7836-4340-ac9e-de32be5b3ad4 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087631 Aug 05 19:56:21.102073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 386/785] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:21.190977 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:21.191596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:21.203824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:21.204313 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:21.204745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:21.207814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:21.208281 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:21.211006 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:21.372287 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:21.375831 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:21.400132 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:21.402963 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:21.403638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:21.405777 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:21.408775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:21.409443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:21.654951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:21.666157 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3684be33-001e-4615-b776-1a72b67f1b3a tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1557 microversion: 2.1 time: 0.479382 Aug 05 19:56:21.669134 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 400/786] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:21 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1557 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:21.698889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:21.701216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:21.718371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:21.720727 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:21.723230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:21.728264 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:21.729314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:21.731215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:21.889056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:21.901137 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:21.902982 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:21.904210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-160f7ffa-a05c-41e3-9c2b-a6b01dc332e7 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.556091 Aug 05 19:56:21.911970 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 387/787] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:21 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:21.996936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e58ea4b8-93f4-437d-a6e1-59e500174fef tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.305272 Aug 05 19:56:22.007123 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 401/788] 10.222.0.86 () {58 vars in 1275 bytes} [Fri Aug 5 19:56:21 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-interface => generated 284 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:22.571755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-db3fd83a-5d65-4d28-b2ca-0965bbf4cf32 req-db5af215-0807-4b06-902b-3f92db451af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9826c-1788-4efe-951b-1092fead7ea9", "name": "network-vif-plugged", "status": "completed", "tag": "a01a901d-1174-4772-9aa0-c8525d67930c"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:22.608329 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-db3fd83a-5d65-4d28-b2ca-0965bbf4cf32 req-db5af215-0807-4b06-902b-3f92db451af1 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:22.610761 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-db3fd83a-5d65-4d28-b2ca-0965bbf4cf32 req-db5af215-0807-4b06-902b-3f92db451af1 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:22.612029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-db3fd83a-5d65-4d28-b2ca-0965bbf4cf32 req-db5af215-0807-4b06-902b-3f92db451af1 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:22.644158 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-db3fd83a-5d65-4d28-b2ca-0965bbf4cf32 req-db5af215-0807-4b06-902b-3f92db451af1 service nova] Creating event network-vif-plugged:a01a901d-1174-4772-9aa0-c8525d67930c for instance cca9826c-1788-4efe-951b-1092fead7ea9 on hv-cinder-85220 Aug 05 19:56:22.657474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-db3fd83a-5d65-4d28-b2ca-0965bbf4cf32 req-db5af215-0807-4b06-902b-3f92db451af1 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093311 Aug 05 19:56:22.661188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 388/789] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:22.961313 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:22.966699 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:23.033794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:23.034903 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:23.040515 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:23.045852 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:23.046371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:23.048006 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:23.061726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:23.394862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:23.416054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:23.420617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:23.423774 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0048d9f0-d672-43cd-8fb0-04ba0785556d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.469253 Aug 05 19:56:23.438711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 402/790] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:22 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:23.985706 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-b406dd45-cf05-482e-b4dd-b1d7a61224e2 req-82a1afbe-64aa-4c03-ae16-4e8c8f31953f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280a9bf9-043d-4a47-8a35-f184de29c2b0", "tag": "30097b8f-4f15-4542-8438-fbe4d2dc888b"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:24.001096 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b406dd45-cf05-482e-b4dd-b1d7a61224e2 req-82a1afbe-64aa-4c03-ae16-4e8c8f31953f service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.002324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b406dd45-cf05-482e-b4dd-b1d7a61224e2 req-82a1afbe-64aa-4c03-ae16-4e8c8f31953f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.002916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b406dd45-cf05-482e-b4dd-b1d7a61224e2 req-82a1afbe-64aa-4c03-ae16-4e8c8f31953f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:24.019880 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-b406dd45-cf05-482e-b4dd-b1d7a61224e2 req-82a1afbe-64aa-4c03-ae16-4e8c8f31953f service nova] Creating event network-changed:30097b8f-4f15-4542-8438-fbe4d2dc888b for instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 on hv-cinder-85220 Aug 05 19:56:24.027217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-b406dd45-cf05-482e-b4dd-b1d7a61224e2 req-82a1afbe-64aa-4c03-ae16-4e8c8f31953f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046357 Aug 05 19:56:24.033876 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 389/791] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:56:24.073916 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:24.077868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:24.102306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.103225 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.104028 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:24.111984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.113526 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.114338 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:24.194552 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-31fa3699-c04b-4850-bba8-e257247e412c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123454 Aug 05 19:56:24.196067 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 403/792] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:56:24 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:24.207777 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:24.208356 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:24.215871 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.216368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.216807 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:24.217519 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.217972 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.218411 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:24.285287 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dc887e50-a4ce-4681-9c11-dac372d21657 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/f4b44591-bd0f-4a0a-aaec-8cf66e7ff129" status: 200 len: 194 microversion: 2.1 time: 0.081763 Aug 05 19:56:24.287768 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 390/793] 10.222.0.86 () {58 vars in 1413 bytes} [Fri Aug 5 19:56:24 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/f4b44591-bd0f-4a0a-aaec-8cf66e7ff129 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:24.496049 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:24.501779 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:24.527330 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.531631 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.532765 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:24.536300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.539431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.543057 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:24.684279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1253507927"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:24.686943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:24.736638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.759217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.759217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:24.766476 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:24.766476 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:24.766476 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:25.044761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:25.059811 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:25.074121 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:25.077713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2aac49d3-4e06-4500-a317-214c44636451 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.595257 Aug 05 19:56:25.079129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 404/794] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:24 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:25.172685 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.network.security_group_api [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Adding security group ddf98b5b-ac2f-4b73-a14f-877322078f5b to port 34a60c93-aacf-4bba-8c03-257ef4588a08 Aug 05 19:56:25.724388 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3b77f13f-1f1d-4ae1-8ee8-cfc62ec73a3c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "POST /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/action" status: 202 len: 0 microversion: 2.1 time: 1.056464 Aug 05 19:56:25.725419 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 391/795] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:56:24 2022] POST /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/action => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 19:56:25.733462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:25.734096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:25.745820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-d501405c-a05a-4bba-95fc-698eb2c3e332 req-42401c3f-e5f4-4fd8-9d00-75ad0875df3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec295b92-6466-4366-ba60-1e1d50beb9d6", "tag": "34a60c93-aacf-4bba-8c03-257ef4588a08"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:25.749898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:25.750408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:25.750876 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:25.751597 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:25.752040 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:25.752467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:25.764578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-d501405c-a05a-4bba-95fc-698eb2c3e332 req-42401c3f-e5f4-4fd8-9d00-75ad0875df3f service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:25.765070 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-d501405c-a05a-4bba-95fc-698eb2c3e332 req-42401c3f-e5f4-4fd8-9d00-75ad0875df3f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:25.765514 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-d501405c-a05a-4bba-95fc-698eb2c3e332 req-42401c3f-e5f4-4fd8-9d00-75ad0875df3f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:25.786106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-d501405c-a05a-4bba-95fc-698eb2c3e332 req-42401c3f-e5f4-4fd8-9d00-75ad0875df3f service nova] Creating event network-changed:34a60c93-aacf-4bba-8c03-257ef4588a08 for instance ec295b92-6466-4366-ba60-1e1d50beb9d6 on hv-cinder-85220 Aug 05 19:56:25.800293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-d501405c-a05a-4bba-95fc-698eb2c3e332 req-42401c3f-e5f4-4fd8-9d00-75ad0875df3f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061473 Aug 05 19:56:25.805490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 392/796] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:56:26.135807 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:26.137396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:26.148393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:26.149302 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:26.151926 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:26.158545 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:26.160237 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:26.160825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:26.237624 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:26.246417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ea6687f5-abc6-4862-9e9a-fab05fade4c4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1760 microversion: 2.1 time: 0.516938 Aug 05 19:56:26.275096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 405/797] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:25 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1760 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:26.283619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d01501c-2228-4f86-b1b8-fea7e5fe6458"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:26.286151 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:26.293453 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:26.293952 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:26.294657 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:26.295664 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:26.296467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:26.297117 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:26.780178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:26.796716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:26.798363 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:26.799753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2d5a9dd2-7473-4325-aedb-29c717c15a86 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.687719 Aug 05 19:56:26.800717 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 393/798] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:26 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:26.835425 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-71c3acfe-38b4-4d79-bb4c-8d6708587e21 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "POST /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558666 Aug 05 19:56:26.836486 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 406/799] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:56:26 2022] POST /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:27.830714 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:27.831319 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:27.838380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:27.839044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:27.839497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:27.843398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:27.844263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:27.846374 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:28.075183 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:28.088733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:28.095288 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:28.096986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d89fb3ac-99b4-4578-9661-fcf90da1c4e2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.270788 Aug 05 19:56:28.110784 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 394/800] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:27 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:29.138278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:29.139417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:29.169684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:29.170426 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:29.171174 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:29.172237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:29.173390 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:29.173592 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:29.505428 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:29.528407 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:29.533191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:29.534993 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-78428a4f-3826-4e68-983c-b54c6b3a9ddd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.416560 Aug 05 19:56:29.537072 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 407/801] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:29 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:30.572328 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:30.574381 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:30.585701 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:30.586942 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:30.587931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:30.589432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:30.590301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:30.591332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:30.807767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:30.821724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:30.823945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:30.825568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-15733e09-fb3d-4361-a37e-f20b37741aa0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.261753 Aug 05 19:56:30.826659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 395/802] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:30 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:31.851747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:31.855911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:31.864992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:31.865862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:31.866479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:31.868528 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:31.869414 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:31.870399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:32.094452 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:32.106074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:32.108020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:32.109422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-293766d3-0c7b-47ea-8fe5-2d7508b297ed tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.264292 Aug 05 19:56:32.110237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 408/803] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:31 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:33.045326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1766949017", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:33.108501 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] validate_networks() for None {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:56:33.137290 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:33.138032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:33.161990 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:33.163096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:33.163737 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:33.164660 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:33.165314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:33.166809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:33.392340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:33.403666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:33.405735 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:33.407329 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6287f5ad-7469-49c2-a194-0afbccdd1ac1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.275197 Aug 05 19:56:33.408496 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 409/804] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:33 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:33.491551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:56:33.492170 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:56:33.492734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:56:33.493214 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:56:33.493703 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:56:33.505439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:33.506175 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:33.506614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:33.507362 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:33.508030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:33.508462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:33.529551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Getting quotas for project 9a5122857f764dcf977389f772000b4e. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:56:33.534423 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Getting quotas for user fb77bfeec5c14d6db3f7a5eb71a6d79f and project 9a5122857f764dcf977389f772000b4e. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:56:33.548787 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:56:33.551653 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:56:33.611290 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0ddf84cd-be1e-4a43-b002-2d52ea37e297 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572731 Aug 05 19:56:33.613155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 396/805] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:56:33.642316 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1b0a1e24-7c7f-47ae-9df2-bda0bf5f36f0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:33.644026 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1b0a1e24-7c7f-47ae-9df2-bda0bf5f36f0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:33.721641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1b0a1e24-7c7f-47ae-9df2-bda0bf5f36f0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:33.734514 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1b0a1e24-7c7f-47ae-9df2-bda0bf5f36f0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1215 microversion: 2.1 time: 0.101691 Aug 05 19:56:33.743543 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 410/806] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:33 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:34.435020 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:34.435648 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:34.443020 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:34.443865 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:34.444312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:34.445031 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:34.445485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:34.446095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:34.607861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:34.616147 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:34.617795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:34.619017 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-160f5ff4-f626-43f5-9ddf-7900ed57b3c0 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1739 microversion: 2.20 time: 0.189233 Aug 05 19:56:34.619578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 397/807] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:34 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:34.762500 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:34.765115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:34.765295 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:34.766397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:34.773684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:34.773684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:34.774107 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:34.775129 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:34.775533 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:34.775978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:34.777390 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:34.779106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:34.781099 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:34.781610 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:34.782468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:34.783312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:34.811812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-929746dc-1f34-4bea-9736-ed855717ca92 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053157 Aug 05 19:56:34.812804 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 411/808] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:56:34 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:34.862658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:34.871037 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-325e7c76-7a8d-4153-86b6-032289833820 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1267 microversion: 2.1 time: 0.109671 Aug 05 19:56:34.871503 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 398/809] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:34 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:34.968306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:34.968910 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:34.975399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:34.975988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:34.976504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:34.977289 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:34.977820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:34.978320 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:35.011811 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-05b61c57-60ce-42c0-a003-775644c8ae77 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/f4b44591-bd0f-4a0a-aaec-8cf66e7ff129" status: 200 len: 194 microversion: 2.1 time: 0.047555 Aug 05 19:56:35.012542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 412/810] 10.222.0.86 () {58 vars in 1413 bytes} [Fri Aug 5 19:56:34 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/f4b44591-bd0f-4a0a-aaec-8cf66e7ff129 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:35.024040 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:35.024542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:35.031670 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:35.032511 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:35.034485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:35.034485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:35.035140 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:35.035581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:35.131817 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lazy-loading 'services' on Instance uuid b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:56:35.213562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8eb0ee9d-ad15-4943-af1b-499e1021dbcc tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/f4b44591-bd0f-4a0a-aaec-8cf66e7ff129" status: 202 len: 0 microversion: 2.1 time: 0.194259 Aug 05 19:56:35.214168 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 399/811] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:56:35 2022] DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/f4b44591-bd0f-4a0a-aaec-8cf66e7ff129 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:56:35.642697 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:35.643348 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:35.650463 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:35.650894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:35.651340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:35.652058 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:35.652516 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:35.652941 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:35.807879 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:35.816475 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:35.818492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:35.819705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7005bf2b-8a3e-4983-9031-83a4a0a3263a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1721 microversion: 2.20 time: 0.181098 Aug 05 19:56:35.820269 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 413/812] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:35 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:35.892483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:35.893225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:35.900324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:35.901027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:35.901402 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:35.902111 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:35.902570 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:35.903029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:36.014967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:36.023878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c027f0d8-3da4-41b0-81fc-0a16a91c6865 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1273 microversion: 2.1 time: 0.135980 Aug 05 19:56:36.024510 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 400/813] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:35 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:36.846705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:36.847325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:36.855160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:36.855648 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:36.856082 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:36.856785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:36.857239 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:36.857824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:37.011125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:37.020998 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:37.022549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:37.023838 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ef267ab4-be71-427b-9acc-79cd15739122 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1721 microversion: 2.20 time: 0.181141 Aug 05 19:56:37.024391 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 414/814] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:36 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:37.047352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:37.048173 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:37.049880 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=85 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:37.055704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:37.056268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:37.056743 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:37.057486 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:37.057967 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:37.058375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:37.372393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:37.381070 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e9674e1c-c6f1-42ec-802b-ddd801293e36 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.337873 Aug 05 19:56:37.381863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 401/815] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:37 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:37.442973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:37.443621 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:37.449801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:37.450297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:37.450806 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:37.451563 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:37.452039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:37.452473 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:37.485208 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9b17d0ca-4415-4ca0-bc47-ed1e28787ef4 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/9d01501c-2228-4f86-b1b8-fea7e5fe6458" status: 200 len: 194 microversion: 2.1 time: 0.063550 Aug 05 19:56:37.492567 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 415/816] 10.222.0.86 () {58 vars in 1413 bytes} [Fri Aug 5 19:56:37 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/9d01501c-2228-4f86-b1b8-fea7e5fe6458 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:37.497946 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:37.498439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:37.507965 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:37.508686 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:37.509179 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:37.509915 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:37.510424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:37.510902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:37.513709 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:37.597335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lazy-loading 'services' on Instance uuid b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:56:37.674220 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3bf1ebf5-3bbb-44bc-84c2-73cf8b173cb1 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/9d01501c-2228-4f86-b1b8-fea7e5fe6458" status: 202 len: 0 microversion: 2.1 time: 0.180036 Aug 05 19:56:37.674845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 402/817] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:56:37 2022] DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments/9d01501c-2228-4f86-b1b8-fea7e5fe6458 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:56:37.720334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-222a4949-a271-4860-8bf0-ec7b49cbe2de req-84debd29-7c6d-4752-ac5a-711078e48c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575d8948-a40b-4af4-bff2-7e36cf37d5ce", "tag": "9088c3ee-264d-4fe2-8a0d-44fca56a85a9"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:37.732113 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-222a4949-a271-4860-8bf0-ec7b49cbe2de req-84debd29-7c6d-4752-ac5a-711078e48c3b service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:37.732662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-222a4949-a271-4860-8bf0-ec7b49cbe2de req-84debd29-7c6d-4752-ac5a-711078e48c3b service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:37.733294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-222a4949-a271-4860-8bf0-ec7b49cbe2de req-84debd29-7c6d-4752-ac5a-711078e48c3b service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:37.746737 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-222a4949-a271-4860-8bf0-ec7b49cbe2de req-84debd29-7c6d-4752-ac5a-711078e48c3b service nova] Creating event network-changed:9088c3ee-264d-4fe2-8a0d-44fca56a85a9 for instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce on hv-cinder-85220 Aug 05 19:56:37.751773 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-222a4949-a271-4860-8bf0-ec7b49cbe2de req-84debd29-7c6d-4752-ac5a-711078e48c3b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035301 Aug 05 19:56:37.752393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 416/818] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:38.048356 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:38.049075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:38.055839 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:38.056328 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:38.056769 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:38.057450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:38.057903 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:38.058346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:38.201219 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:38.210494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:38.212019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:38.213171 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-07f81acf-25e9-4df7-966a-48b22660cb73 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1721 microversion: 2.20 time: 0.169657 Aug 05 19:56:38.213722 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 403/819] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:38 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:38.403658 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:38.404356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:38.410658 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:38.411176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:38.411607 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:38.412298 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:38.412833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:38.413259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:38.553498 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:38.560849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f29d9c2e-a366-45e6-8896-b0be1b6d6d0c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.162667 Aug 05 19:56:38.561405 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 417/820] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:38 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:39.235934 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:39.236530 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:39.244735 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:39.245238 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:39.245675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:39.246390 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:39.246885 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:39.247325 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:39.463578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:39.472333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:39.474016 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:39.475467 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e94a1d3e-04e4-4647-8efc-536ad7cf60e1 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1721 microversion: 2.20 time: 0.243590 Aug 05 19:56:39.485617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 404/821] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:39 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:39.583492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:39.584042 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:39.590494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:39.591093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:39.591531 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:39.592221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:39.592678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:39.593104 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:39.738792 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:39.752934 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c1015144-fd29-40a1-8a2d-aa65b56cd1d1 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.173980 Aug 05 19:56:39.759894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 418/822] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:39 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:39.915944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:39.918378 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:39.924517 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:39.925675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:39.926129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:39.927981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:39.928509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:39.928981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:39.959518 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9f913735-065f-4bb9-923d-e7e1c136e1a8 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048459 Aug 05 19:56:39.960097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 405/823] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:56:39 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:56:40.084250 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:40.086649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:40.093056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.093548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.094056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.094865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.095394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.095899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.101103 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:40.129192 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f9f2eed4-7121-4a51-a656-faf4fceb7e5c tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049784 Aug 05 19:56:40.130412 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 419/824] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:56:40 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:56:40.158819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-0d22113f-22b4-4a28-97bb-1f915b223e04 req-096c9a64-ff1c-40af-9af5-31a3c20ea234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9826c-1788-4efe-951b-1092fead7ea9", "name": "network-vif-unplugged", "status": "completed", "tag": "a01a901d-1174-4772-9aa0-c8525d67930c"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:40.177915 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0d22113f-22b4-4a28-97bb-1f915b223e04 req-096c9a64-ff1c-40af-9af5-31a3c20ea234 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.178942 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0d22113f-22b4-4a28-97bb-1f915b223e04 req-096c9a64-ff1c-40af-9af5-31a3c20ea234 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.179582 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0d22113f-22b4-4a28-97bb-1f915b223e04 req-096c9a64-ff1c-40af-9af5-31a3c20ea234 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.194614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.compute.server_external_events [req-0d22113f-22b4-4a28-97bb-1f915b223e04 req-096c9a64-ff1c-40af-9af5-31a3c20ea234 service nova] Unable to find a host for instance cca9826c-1788-4efe-951b-1092fead7ea9. Dropping event network-vif-unplugged {{(pid=124552) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 19:56:40.195924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-0d22113f-22b4-4a28-97bb-1f915b223e04 req-096c9a64-ff1c-40af-9af5-31a3c20ea234 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041333 Aug 05 19:56:40.196706 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 406/825] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 19:56:40.214579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:40.215273 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:40.226373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.226987 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.227490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.228259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.229037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.229682 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.259479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Going to try to terminate instance {{(pid=124553) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:56:40.339322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-67e4add8-a14f-4448-924d-ab240947234e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 204 len: 0 microversion: 2.1 time: 0.128763 Aug 05 19:56:40.339931 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 420/826] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:56:40 2022] DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:56:40.348128 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:40.348724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:40.355379 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.355877 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.356323 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.357040 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.357503 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.357940 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.500084 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:40.501831 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:40.506032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:40.510056 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.510547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.511382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.512659 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.513228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.513635 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.522446 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-12fb2343-ec69-41b2-9d01-9e58a6840aae tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1672 microversion: 2.1 time: 0.177821 Aug 05 19:56:40.523586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 407/827] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:40 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:40.655961 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:40.664393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:40.665972 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:40.667922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-aec40f19-c17d-4874-a80a-bb5f1ea36509 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1664 microversion: 2.20 time: 0.172253 Aug 05 19:56:40.667922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 421/828] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:40 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:40.696152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b39c9c-40fe-4c63-881b-fbc537485637"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:40.696152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:40.701528 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.702014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.702446 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.703182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.703625 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.704125 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.775749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:40.776274 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:40.782823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.783322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.783764 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.784652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:40.785115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:40.785651 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:40.931364 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:40.938955 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-606ca766-9d2f-4b09-b614-4bd23e55cb1c tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.167356 Aug 05 19:56:40.939715 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 422/829] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:40 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:41.008702 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-775395cd-05ef-4035-b7db-4ac514fdbc2b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.320465 Aug 05 19:56:41.009298 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 408/830] 10.222.0.86 () {62 vars in 1364 bytes} [Fri Aug 5 19:56:40 2022] POST /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:56:41.136184 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:41.136632 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:41.142526 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.143041 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.143476 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.144166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.144619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.145041 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.398849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9f48eaf5-70e1-4b32-943b-cf33beec88ef tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/os-volume_attachments/99b39c9c-40fe-4c63-881b-fbc537485637" status: 202 len: 0 microversion: 2.20 time: 0.268127 Aug 05 19:56:41.399457 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 423/831] 10.222.0.86 () {60 vars in 1457 bytes} [Fri Aug 5 19:56:41 2022] DELETE /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/os-volume_attachments/99b39c9c-40fe-4c63-881b-fbc537485637 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:56:41.463008 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:41.463769 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:41.470863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.471346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.471782 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.472498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.472926 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.474102 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.505944 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124552) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 19:56:41.545367 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:41.545980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:41.552457 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.552940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.553372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.554097 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.554553 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.555032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.584215 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e5834903-b7ed-41c3-a10a-2f8e893db60b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "POST /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/action" status: 202 len: 0 microversion: 2.20 time: 0.126332 Aug 05 19:56:41.585010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 409/832] 10.222.0.86 () {62 vars in 1319 bytes} [Fri Aug 5 19:56:41 2022] POST /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:56:41.593187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:41.593810 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:41.600628 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.601351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.601796 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.602519 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.603009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.603618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.762763 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:41.766247 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:41.771355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:41.772916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:41.774093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7170a73a-90e8-4f4b-96a2-5ee5852c6b43 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1672 microversion: 2.20 time: 0.184978 Aug 05 19:56:41.774520 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f8c60dd6-5fd1-4579-84e4-c823300067e6 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1672 microversion: 2.1 time: 0.232996 Aug 05 19:56:41.774688 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 410/833] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:41 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:41.779136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 424/834] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:41 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:41.960348 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:41.961082 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:41.971870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.971870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.971870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:41.971870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:41.972291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:41.972291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:42.118195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:42.125832 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ab69bf35-f67f-47e6-9b00-ab3ee5850153 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.169570 Aug 05 19:56:42.126408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 425/835] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:41 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:42.795647 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:42.796365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:42.797237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:42.797862 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:42.804472 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:42.804973 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:42.805420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:42.805524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:42.805920 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:42.806130 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:42.806349 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:42.806688 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:42.807073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:42.807171 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:42.807523 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:42.807943 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:42.950830 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:42.954662 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:42.961850 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9b584472-2be6-421a-bedc-bc420a3400d9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1672 microversion: 2.1 time: 0.169907 Aug 05 19:56:42.962864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 411/836] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:42 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:42.966183 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:42.968044 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:42.969613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-76c6dd13-71bd-4584-a0c4-17fc692372ab tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1672 microversion: 2.20 time: 0.176265 Aug 05 19:56:42.970257 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 426/837] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:42 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:43.147509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:43.148158 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:43.154189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:43.154745 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:43.155191 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:43.155901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:43.156363 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:43.156874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:43.391617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:43.399398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-56b53b35-344c-4b7c-9699-e7aacad16641 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.255920 Aug 05 19:56:43.400063 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 412/838] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:43 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:43.985817 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:43.986499 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:43.988629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:43.996930 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:43.997736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:43.998333 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:43.998574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:43.999116 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:43.999243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:43.999675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:44.000099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:44.001552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:44.002327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=6 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:44.012447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:44.012447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:44.012447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:44.012853 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:44.013141 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:44.013579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:44.073499 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:44.084340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-72112dbd-8590-4910-9492-fb3b909efae9 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1604 microversion: 2.1 time: 0.102533 Aug 05 19:56:44.085348 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 427/839] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:43 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1604 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:44.384693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:44.398097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:44.401123 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:44.403075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ef6756ba-78aa-4e29-9a01-c4150e612710 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.409588 Aug 05 19:56:44.404012 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 413/840] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:43 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:44.425054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:44.425668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:44.433915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:44.434412 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:44.434908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:44.435792 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:44.436256 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:44.436684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:44.601340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:44.631517 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f80ecbed-b385-466b-8b0f-fd3f6839dccd tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.208804 Aug 05 19:56:44.632156 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 428/841] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:44 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:44.953204 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-fea0c341-27d0-4bb7-a12c-dccdffa8acc1 req-9f8fdee6-05c1-46f3-998c-46104c90f2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6", "name": "network-vif-deleted", "tag": "f7c6c3d7-c542-4392-baac-c0cb1d1a7ee6"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:44.975902 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-fea0c341-27d0-4bb7-a12c-dccdffa8acc1 req-9f8fdee6-05c1-46f3-998c-46104c90f2d1 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:44.976490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-fea0c341-27d0-4bb7-a12c-dccdffa8acc1 req-9f8fdee6-05c1-46f3-998c-46104c90f2d1 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:44.977498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-fea0c341-27d0-4bb7-a12c-dccdffa8acc1 req-9f8fdee6-05c1-46f3-998c-46104c90f2d1 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:44.993215 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-fea0c341-27d0-4bb7-a12c-dccdffa8acc1 req-9f8fdee6-05c1-46f3-998c-46104c90f2d1 service nova] Creating event network-vif-deleted:f7c6c3d7-c542-4392-baac-c0cb1d1a7ee6 for instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 on hv-cinder-85220 Aug 05 19:56:45.000583 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-fea0c341-27d0-4bb7-a12c-dccdffa8acc1 req-9f8fdee6-05c1-46f3-998c-46104c90f2d1 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052323 Aug 05 19:56:45.001724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 414/842] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:45.106360 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:45.107653 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:45.111137 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:45.114854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:45.115345 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:45.115784 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:45.116492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:45.116954 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:45.117380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:45.164973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:45.165921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:45.166514 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:45.167153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lazy-loading 'fault' on Instance uuid b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:56:45.215783 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074f3ddb689c4a60a05d3267080d7e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db26f543ab4a67b932184ba810f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:45.225703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-84877610-e247-4b47-9383-b327a6028a8f tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 200 len: 1327 microversion: 2.1 time: 0.123344 Aug 05 19:56:45.230684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 429/843] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:45 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:45.430002 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:45.430737 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:45.437394 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:45.438085 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:45.438532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:45.439272 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:45.439737 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:45.440169 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:45.655479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:45.658109 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:45.659214 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:45.662074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:45.666683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:45.668229 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:45.669430 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-cbbdf02c-ca69-40b9-8530-2c45c684b367 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.244123 Aug 05 19:56:45.672645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:45.673149 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:45.673644 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:45.674514 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:45.675159 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:45.675593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:45.679317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 415/844] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:45 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:45.999849 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:46.023189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-917dc1ba-1308-4f3e-91e7-31c63f936b1a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.372933 Aug 05 19:56:46.030692 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 430/845] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:45 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:46.249928 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:46.251197 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:46.270782 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:46.271719 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:46.272333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:46.273236 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:46.273865 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:46.274483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:46.313957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] HTTP exception thrown: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Request method failure captured: Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 HTTP/1.1 Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRh2onWclJE9pSVd8UUFtQu8ImB7b6dp8OcMAVEOkZx6yK7J2VZ856El7MpgJbMZrDosXRjOqd50LkaVdRzu2b_94rfaZopuQodwH7PbEQgngY1T-ptP16UjnSaVat3eANjfRrHY9eyp6gfsdHxs7OQlrO45KfV_qNSa25gPi0FpG0 Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:56:46.315698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}] Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 074f3ddb689c4a60a05d3267080d7e7a Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:46.317505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6'} Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:46.318509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:46.320079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:46.321408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Returning 404 to user: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:46.321408 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-67636968-f9d5-4fe1-9ea3-14ed6b61faee tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 404 len: 111 microversion: 2.1 time: 0.076111 Aug 05 19:56:46.321704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 416/846] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:46 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:56:46.326748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-15ac707f-9878-4ba0-b8a2-2d6857dc3342 req-84020ea2-6f7e-4c5a-adba-d1dd3385903a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575d8948-a40b-4af4-bff2-7e36cf37d5ce", "name": "network-vif-plugged", "status": "completed", "tag": "9088c3ee-264d-4fe2-8a0d-44fca56a85a9"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:46.339783 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-446b6d16-2039-49dd-aa6f-41745e694e62 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '.version_select at 0x7f18c800e4c0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:46.358189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-15ac707f-9878-4ba0-b8a2-2d6857dc3342 req-84020ea2-6f7e-4c5a-adba-d1dd3385903a service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:46.360606 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-15ac707f-9878-4ba0-b8a2-2d6857dc3342 req-84020ea2-6f7e-4c5a-adba-d1dd3385903a service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:46.361898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-15ac707f-9878-4ba0-b8a2-2d6857dc3342 req-84020ea2-6f7e-4c5a-adba-d1dd3385903a service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:46.368647 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:46.383995 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-15ac707f-9878-4ba0-b8a2-2d6857dc3342 req-84020ea2-6f7e-4c5a-adba-d1dd3385903a service nova] Creating event network-vif-plugged:9088c3ee-264d-4fe2-8a0d-44fca56a85a9 for instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce on hv-cinder-85220 Aug 05 19:56:46.394924 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-446b6d16-2039-49dd-aa6f-41745e694e62 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146204634" status: 202 len: 0 microversion: 2.1 time: 0.067458 Aug 05 19:56:46.396404 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 417/847] 10.222.0.86 () {58 vars in 1221 bytes} [Fri Aug 5 19:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146204634 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:56:46.408699 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-15ac707f-9878-4ba0-b8a2-2d6857dc3342 req-84020ea2-6f7e-4c5a-adba-d1dd3385903a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084795 Aug 05 19:56:46.409462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 431/848] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:56:46.695078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:46.695822 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:46.709522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:46.710177 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:46.712103 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:46.713311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:46.715196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:46.715761 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:47.027117 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:47.045386 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:47.047403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:47.048929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-894b6a51-8a45-4207-93be-5e62c344b3fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.359613 Aug 05 19:56:47.062652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:47.062652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:47.063896 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 418/849] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:46 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:47.072272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:47.073078 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:47.074116 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:47.075230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:47.075928 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:47.076619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:47.239937 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:47.249742 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a5e37fa3-3dff-43ba-a070-23bf3cac1b81 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.204692 Aug 05 19:56:47.250728 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 432/850] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:47 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:48.077591 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:48.078732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:48.086600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:48.087307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:48.087804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:48.088570 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:48.089033 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:48.089460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:48.277489 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:48.281528 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:48.282978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:48.296254 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:48.297115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:48.299234 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:48.299872 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:48.300499 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:48.303564 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:48.304346 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:48.311728 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:48.312923 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-63c814b7-72bc-421d-ac5c-520ba750ecd6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.240361 Aug 05 19:56:48.314708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 419/851] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:48 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:48.484663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:48.496442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fcaa7455-31d2-4377-9124-72d544a09dcc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.226409 Aug 05 19:56:48.497898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 433/852] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:48 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:48.984010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:48.987082 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:48.993755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:48.994311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:48.995069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:48.995998 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:48.996615 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:48.997059 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.096929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-01efed1d-80af-4feb-8d2c-a6961de0a42b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "POST /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/action" status: 202 len: 0 microversion: 2.1 time: 0.116775 Aug 05 19:56:49.098809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 420/853] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:56:48 2022] POST /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:56:49.106243 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:49.106889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:49.113058 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.113955 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.114426 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.115224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.115684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.116182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.350855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:49.352028 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:49.358846 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.359336 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.359773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.360477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.360929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.361351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.470462 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:49.486139 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c044d979-5930-4135-a9e1-3dcaa0774544 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1752 microversion: 2.1 time: 0.383533 Aug 05 19:56:49.486823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 434/854] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:49 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1752 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:49.524190 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:49.525214 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:49.532161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.532685 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.533130 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.533901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.534354 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.535397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.536971 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:49.559482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:49.561355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:49.562575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-39f91148-295d-406d-b01a-a1a59e795e03 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.218722 Aug 05 19:56:49.563166 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 421/855] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:49 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:49.695505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:49.696407 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:49.702884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.703638 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.704087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.704825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.705279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.705707 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.739228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:49.742066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] HTTP exception thrown: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Request method failure captured: Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 HTTP/1.1 Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRh2onWclJE9pSVd8UUFtQu8ImB7b6dp8OcMAVEOkZx6yK7J2VZ856El7MpgJbMZrDosXRjOqd50LkaVdRzu2b_94rfaZopuQodwH7PbEQgngY1T-ptP16UjnSaVat3eANjfRrHY9eyp6gfsdHxs7OQlrO45KfV_qNSa25gPi0FpG0 Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:56:49.744113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}] Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 074f3ddb689c4a60a05d3267080d7e7a Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.746216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6'} Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:49.747014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.749365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.751057 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Returning 404 to user: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:49.751057 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7494e90e-7e0b-4330-9aa0-5030af552f50 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 404 len: 111 microversion: 2.1 time: 0.055776 Aug 05 19:56:49.751057 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 422/856] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:56:49 2022] DELETE /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:56:49.755752 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:49.756412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:49.759373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7471c911-cd25-43f4-9447-5e05c386eff6 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.239902 Aug 05 19:56:49.775969 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 435/857] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:49 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:49.776792 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.777575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.778055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.778877 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:49.779370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:49.779833 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:49.796265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] HTTP exception thrown: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Request method failure captured: Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 HTTP/1.1 Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRh2onWclJE9pSVd8UUFtQu8ImB7b6dp8OcMAVEOkZx6yK7J2VZ856El7MpgJbMZrDosXRjOqd50LkaVdRzu2b_94rfaZopuQodwH7PbEQgngY1T-ptP16UjnSaVat3eANjfRrHY9eyp6gfsdHxs7OQlrO45KfV_qNSa25gPi0FpG0 Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:56:49.798744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}] Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 074f3ddb689c4a60a05d3267080d7e7a Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.800455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6'} Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:49.802321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. Aug 05 19:56:49.804069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:49.805135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Returning 404 to user: Instance b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:49.805135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ffef294b-c520-4174-82be-8da185e4c17d tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6" status: 404 len: 111 microversion: 2.1 time: 0.049392 Aug 05 19:56:49.805135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 423/858] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:49 2022] GET /compute/v2.1/servers/b51cf7c5-ee6d-4e8a-b99c-4a3ab8b852a6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 19:56:50.511468 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:50.513631 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:50.520884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:50.521378 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:50.521820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:50.522616 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:50.523125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:50.523581 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:50.591038 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:50.591769 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:50.600061 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:50.601145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:50.601854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:50.602886 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:50.604129 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:50.605248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:50.716201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:50.727070 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6dab0660-6dcd-4f8f-9f31-a47d479f7558 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1752 microversion: 2.1 time: 0.221981 Aug 05 19:56:50.727666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 436/859] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:50 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1752 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:50.774524 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:50.783142 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:50.783929 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:50.791788 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:50.792484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:50.793094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:50.793923 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:50.794490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:50.794682 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:50.795141 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:50.796376 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:50.797603 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b33bfef5-c5cd-40c5-a220-87fbbfd52787 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.211653 Aug 05 19:56:50.798532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 424/860] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:50 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:50.962059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:50.971747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3b2d1057-d287-4fbc-9049-ec768b45a098 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.192632 Aug 05 19:56:50.973732 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 437/861] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:50 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:51.006020 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:51.006573 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:51.015483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:51.016077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:51.016626 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:51.017649 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:51.018248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:51.018784 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:51.036218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] HTTP exception thrown: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Request method failure captured: Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: DELETE /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 HTTP/1.1 Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRh2onWclJE9pSVd8UUFtQu8ImB7b6dp8OcMAVEOkZx6yK7J2VZ856El7MpgJbMZrDosXRjOqd50LkaVdRzu2b_94rfaZopuQodwH7PbEQgngY1T-ptP16UjnSaVat3eANjfRrHY9eyp6gfsdHxs7OQlrO45KfV_qNSa25gPi0FpG0 Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:56:51.037734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}] Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 074f3ddb689c4a60a05d3267080d7e7a Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.039300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '8482cf3d-db2a-41f0-93d3-dece8a8a46f1'} Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:51.040095 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.041417 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.042609 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Returning 404 to user: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:51.042609 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5d7660d1-42ee-4e30-b438-2340c1f49c4e tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "DELETE /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 404 len: 111 microversion: 2.1 time: 0.050132 Aug 05 19:56:51.042609 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 425/862] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:56:50 2022] DELETE /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:56:51.049474 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:51.050264 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] [instance: 8482cf3d-db2a-41f0-93d3-dece8a8a46f1] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:51.063510 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:51.064163 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:51.064613 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:51.065326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:51.065790 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:51.066221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:51.083478 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] HTTP exception thrown: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Request method failure captured: Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 HTTP/1.1 Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRh2onWclJE9pSVd8UUFtQu8ImB7b6dp8OcMAVEOkZx6yK7J2VZ856El7MpgJbMZrDosXRjOqd50LkaVdRzu2b_94rfaZopuQodwH7PbEQgngY1T-ptP16UjnSaVat3eANjfRrHY9eyp6gfsdHxs7OQlrO45KfV_qNSa25gPi0FpG0 Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:56:51.085203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_21db26f543ab4a67b932184ba810f4e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/21db26f543ab4a67b932184ba810f4e9"}]}] Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 21db26f543ab4a67b932184ba810f4e9 Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-527921210 Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 074f3ddb689c4a60a05d3267080d7e7a Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeTestJSON-527921210-project Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.092020 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '8482cf3d-db2a-41f0-93d3-dece8a8a46f1'} Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:51.093894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. Aug 05 19:56:51.096525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:56:51.099979 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] Returning 404 to user: Instance 8482cf3d-db2a-41f0-93d3-dece8a8a46f1 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:51.099979 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-deea1a96-2473-4fe9-9430-0222b63f2335 tempest-AttachVolumeTestJSON-527921210 tempest-AttachVolumeTestJSON-527921210-project] 10.222.0.86 "GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1" status: 404 len: 111 microversion: 2.1 time: 0.041230 Aug 05 19:56:51.099979 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 438/863] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:51 2022] GET /compute/v2.1/servers/8482cf3d-db2a-41f0-93d3-dece8a8a46f1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:56:51.749551 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:51.750189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:51.761292 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:51.762181 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:51.764210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:51.766133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:51.766963 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:51.767907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:51.834520 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:51.835334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:51.843645 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:51.844179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:51.844836 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:51.845738 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:51.846365 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:51.846994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:52.006090 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:52.014865 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:52.016397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:52.017569 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ad1fc8fe-5dbe-4fd3-9b7d-4157bda014ba tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.187645 Aug 05 19:56:52.018350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 439/864] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:51 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:52.028057 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:52.028970 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:52.041663 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:52.042410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:52.043053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:52.043965 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:52.044431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:52.044981 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:52.152152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:52.167337 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ca52672c-adf8-4360-b9b5-196a4ac98a5b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1752 microversion: 2.1 time: 0.421726 Aug 05 19:56:52.186577 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 426/865] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:51 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1752 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:52.235803 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:52.246147 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d31b6971-d565-49ee-949f-60e211438b79 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.222283 Aug 05 19:56:52.247306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 440/866] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:52 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:53.047470 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:53.049149 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:53.058777 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:53.059364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:53.060309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:53.061251 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:53.061936 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:53.062592 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:53.193689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:53.194297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:53.201084 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:53.201576 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:53.202253 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:53.202891 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:53.203354 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:53.203771 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:53.316455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:53.329612 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:53.334335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:53.336676 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4cc7e404-522a-4ebe-9d32-48b356ffa954 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.294772 Aug 05 19:56:53.354171 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 427/867] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:53 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:53.365940 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:53.366572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:53.387073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:53.387841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:53.388316 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:53.389004 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:53.389460 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:53.389888 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:53.638189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:53.638368 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:53.649245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c0ddb0c3-476e-4fcf-8018-51f163e84166 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1752 microversion: 2.1 time: 0.460871 Aug 05 19:56:53.652020 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b1a2cf7c-2a4f-4c16-b877-6edb16c8a3bc tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.294502 Aug 05 19:56:53.652651 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 428/868] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:53 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:53.666183 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 441/869] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:53 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1752 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:54.365569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:54.365999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:54.373675 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:54.374179 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:54.374650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:54.375369 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:54.375857 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:54.376285 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:54.522562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:54.531229 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:54.532793 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:54.533985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b16c6535-dc17-429c-98a6-2ff4b1445cd8 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.173840 Aug 05 19:56:54.534695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 429/870] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:54 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:54.675145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:54.676896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:54.684387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:54.684889 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:54.685366 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:54.686086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:54.686547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:54.687004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:54.689625 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:54.690441 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:54.698850 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:54.699348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:54.699785 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:54.700503 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:54.700954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:54.701588 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:54.887953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:54.897286 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-16d5f74e-079d-4299-bcd0-24cd58f3b56a tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.226889 Aug 05 19:56:54.897863 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 442/871] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:54 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:54.908746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:54.927534 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-02c8df5c-181c-4924-90f2-6f48946e5f18 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1752 microversion: 2.1 time: 0.241290 Aug 05 19:56:54.928351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 430/872] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:54 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1752 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:55.559363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:55.560053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:55.566264 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:55.567556 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:55.568109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:55.568953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:55.569526 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:55.570059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:55.831798 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:55.862478 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:55.865443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:55.869385 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fd5d1742-f246-4a87-aeb8-dfcbdd74584a tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.314086 Aug 05 19:56:55.870867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 443/873] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:55 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:55.923734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:55.924659 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:55.940074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:55.944877 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:55.945290 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:55.945977 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:55.947055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:55.948019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:55.953671 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:55.954303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:55.964228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:55.966057 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:55.967986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:55.969241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:55.971750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:55.972362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:56.258411 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:56.265789 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-018d7804-91cd-4e08-8f05-2aa4943dd2ed tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.350245 Aug 05 19:56:56.266358 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 431/874] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:55 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:56.337241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:56.346553 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b1b5a492-c8a7-4627-a87c-26d9dad9ec77 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1752 microversion: 2.1 time: 0.398709 Aug 05 19:56:56.347173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 444/875] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:55 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1752 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:56.895964 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:56.896841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:56.903471 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:56.903960 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:56.904398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:56.905105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:56.905562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:56.905990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:57.052637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:57.061100 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:57.062687 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:57.063854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-524dfa54-bd52-46d1-8f5d-75d57002bf7d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.173544 Aug 05 19:56:57.064403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 432/876] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:56 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:57.287600 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:57.288228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:57.295518 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:57.295938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:57.296380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:57.297087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:57.297546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:57.297976 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:57.370986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:57.374822 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:57.384003 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:57.384804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:57.385247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:57.385961 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:57.386643 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:57.387230 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:57.486981 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:57.496627 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-83e5b953-27e4-4a65-8fc1-9ad321527b9d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1315 microversion: 2.1 time: 0.213357 Aug 05 19:56:57.497097 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 445/877] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:57 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:57.649797 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:57.659719 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9a330ae5-688d-4c1d-b695-7164f3780950 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1752 microversion: 2.1 time: 0.292850 Aug 05 19:56:57.660487 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 433/878] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:57 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1752 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:56:58.088241 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:58.088866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:58.094901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.095393 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.095838 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.097365 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.098201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.098616 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.262616 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:58.272783 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:58.274499 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:58.275763 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f07ab325-d5b0-44a5-b9fa-3f65ccd92fd4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.192034 Aug 05 19:56:58.276332 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 446/879] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:58 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:58.517874 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:58.518585 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:58.526228 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.526739 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.527398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.528108 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.528559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.528983 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.663705 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:58.671520 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-039ad92e-e206-4a84-988d-74cb700373ea tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1464 microversion: 2.1 time: 0.157639 Aug 05 19:56:58.672097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 434/880] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:58 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:58.684592 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:58.685875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:58.693405 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.693904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.694405 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.695060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.695513 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.695937 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.720296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:58.720798 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:58.730548 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.731437 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.732251 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.733188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.733918 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.734550 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.739210 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:58.764945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:56:58.864914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:58.875351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-81006994-4a29-4a16-88fd-795f0842400e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "DELETE /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 204 len: 0 microversion: 2.1 time: 0.158608 Aug 05 19:56:58.876098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 435/881] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:56:58 2022] DELETE /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 19:56:58.877013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-86081fa0-1c75-4623-9888-c09481f60540 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.197420 Aug 05 19:56:58.877654 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 447/882] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:58 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:58.895525 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:58.896318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:58.904299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.904810 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.905249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:58.905987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:58.906470 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:58.906920 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:59.054212 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:59.062668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5532dd52-4ce5-47a3-ac61-294270acc67d tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1470 microversion: 2.1 time: 0.177776 Aug 05 19:56:59.063335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 436/883] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:58 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:59.087795 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f8411eaf-93d8-4fed-ab85-627fcff2cc98 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c80540d0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:59.137013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f8411eaf-93d8-4fed-ab85-627fcff2cc98 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/bdf0cbb3-4e21-4ec1-839d-2f95b98048c9" status: 200 len: 351 microversion: 2.1 time: 0.053090 Aug 05 19:56:59.137579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 448/884] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:56:59 2022] GET /compute/v2.1/os-volumes/bdf0cbb3-4e21-4ec1-839d-2f95b98048c9 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:59.299945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:59.300914 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:59.307577 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:59.308066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:59.308505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:59.309250 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:59.309709 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:59.310144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:59.460566 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:59.470311 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:59.471856 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:56:59.473592 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-84650eb2-a60e-415c-8e20-9e2e896eb0b2 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.177697 Aug 05 19:56:59.474249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 437/885] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:56:59 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:59.911579 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:59.912214 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:56:59.918965 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:59.919457 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:59.919942 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:56:59.920733 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:56:59.921138 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:56:59.921569 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:00.081689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:00.083899 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:00.084526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:00.089791 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-97af7fa5-c562-4097-ae66-a5f03f4bcb87 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.182962 Aug 05 19:57:00.090350 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 449/886] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:56:59 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:00.091390 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:00.091912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:00.092369 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:00.093081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:00.093544 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:00.093980 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:00.229708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:00.237818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-eb76ecb6-1d73-4d75-8eb9-1fe089293f9e tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1470 microversion: 2.1 time: 0.157887 Aug 05 19:57:00.239519 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 438/887] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:00 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:00.286138 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-e06e4cc7-b6ce-4318-b5ac-823ce82f0932 req-79986beb-fe0c-441c-8378-8f9df541fcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9826c-1788-4efe-951b-1092fead7ea9", "name": "network-vif-plugged", "status": "completed", "tag": "a01a901d-1174-4772-9aa0-c8525d67930c"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:00.296230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-e06e4cc7-b6ce-4318-b5ac-823ce82f0932 req-79986beb-fe0c-441c-8378-8f9df541fcdc service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:00.297141 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-e06e4cc7-b6ce-4318-b5ac-823ce82f0932 req-79986beb-fe0c-441c-8378-8f9df541fcdc service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:00.297584 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-e06e4cc7-b6ce-4318-b5ac-823ce82f0932 req-79986beb-fe0c-441c-8378-8f9df541fcdc service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:00.302880 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:00.310805 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-e06e4cc7-b6ce-4318-b5ac-823ce82f0932 req-79986beb-fe0c-441c-8378-8f9df541fcdc service nova] Creating event network-vif-plugged:a01a901d-1174-4772-9aa0-c8525d67930c for instance cca9826c-1788-4efe-951b-1092fead7ea9 on hv-cinder-85220 Aug 05 19:57:00.315784 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-e06e4cc7-b6ce-4318-b5ac-823ce82f0932 req-79986beb-fe0c-441c-8378-8f9df541fcdc service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033652 Aug 05 19:57:00.317282 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 450/888] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:00.501708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:00.502328 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:00.509526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:00.510178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:00.510680 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:00.511335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-69fc3a49-76d1-4861-a94c-f9dd77fb6d3a tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c8054b80>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:00.511557 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:00.512031 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:00.512835 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:00.574094 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-69fc3a49-76d1-4861-a94c-f9dd77fb6d3a tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/7f5bf99c-755e-42f0-96fb-ec322da1b7a7" status: 200 len: 350 microversion: 2.1 time: 0.067077 Aug 05 19:57:00.574683 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 451/889] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:57:00 2022] GET /compute/v2.1/os-volumes/7f5bf99c-755e-42f0-96fb-ec322da1b7a7 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:00.766370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:00.775911 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:00.777452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:00.778617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9a5ea6e7-e107-431b-86e4-52e209123af4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.281065 Aug 05 19:57:00.779405 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 439/890] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:00 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:01.111194 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:01.111926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:01.119933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:01.120901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:01.121337 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:01.122048 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:01.122506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:01.122959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:01.139252 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-c2b98059-7338-40b3-930c-3500d8cf6b75 req-30d7d9e1-102f-4fca-808e-307c7a72aa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575d8948-a40b-4af4-bff2-7e36cf37d5ce", "name": "network-vif-deleted", "tag": "9088c3ee-264d-4fe2-8a0d-44fca56a85a9"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:01.152538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c2b98059-7338-40b3-930c-3500d8cf6b75 req-30d7d9e1-102f-4fca-808e-307c7a72aa1e service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:01.153397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c2b98059-7338-40b3-930c-3500d8cf6b75 req-30d7d9e1-102f-4fca-808e-307c7a72aa1e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:01.154093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c2b98059-7338-40b3-930c-3500d8cf6b75 req-30d7d9e1-102f-4fca-808e-307c7a72aa1e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:01.175290 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-c2b98059-7338-40b3-930c-3500d8cf6b75 req-30d7d9e1-102f-4fca-808e-307c7a72aa1e service nova] Creating event network-vif-deleted:9088c3ee-264d-4fe2-8a0d-44fca56a85a9 for instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce on hv-cinder-85220 Aug 05 19:57:01.182966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-c2b98059-7338-40b3-930c-3500d8cf6b75 req-30d7d9e1-102f-4fca-808e-307c7a72aa1e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048069 Aug 05 19:57:01.183695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 440/891] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:57:01.266554 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:01.268013 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:01.279757 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:01.280580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:01.281376 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:01.282579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:01.283410 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:01.284360 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:01.315522 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:01.326872 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a1514f44-df15-4a57-88d2-e769a60c53f3 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.220032 Aug 05 19:57:01.327675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 452/892] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:01 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:01.373957 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:01.383365 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0535c35d-4796-41bf-8a82-d455744bed60 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1300 microversion: 2.1 time: 0.125572 Aug 05 19:57:01.383965 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 441/893] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:01 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:01.802771 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:01.875866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:01.875866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:01.875866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:01.875866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:01.876324 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:01.876324 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:01.876324 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:01.959060 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-62b08f7c-b9fe-4a60-ad38-fa6213e88301 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c800e700>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:01.983212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:01.999130 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:02.002454 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:02.004422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6c1e248c-8ef9-42bf-b4d0-6a0ce726f48b tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.205731 Aug 05 19:57:02.005289 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 453/894] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:01 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:02.048617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-62b08f7c-b9fe-4a60-ad38-fa6213e88301 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/4ce12255-fb08-4f56-a438-777d6b5fba83" status: 200 len: 351 microversion: 2.1 time: 0.093473 Aug 05 19:57:02.049685 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 442/895] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:57:01 2022] GET /compute/v2.1/os-volumes/4ce12255-fb08-4f56-a438-777d6b5fba83 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:57:02.064008 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-183126e3-9886-4bd3-89ba-c10befeea748 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c37b2040>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.150615 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-183126e3-9886-4bd3-89ba-c10befeea748 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090785 Aug 05 19:57:02.151538 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 454/896] 10.222.0.86 () {58 vars in 1134 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:57:02.165732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-893b0fcd-ae23-417d-91c0-24c64fa7667b tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c8012dc0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.250970 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-893b0fcd-ae23-417d-91c0-24c64fa7667b tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089516 Aug 05 19:57:02.251563 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 443/897] 10.222.0.86 () {58 vars in 1149 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:02.265416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ba731a21-0607-4e3f-9d40-1ca91e1e8062 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c36d4550>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.351335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.352100 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:02.361832 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ba731a21-0607-4e3f-9d40-1ca91e1e8062 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100366 Aug 05 19:57:02.362820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 455/898] 10.222.0.86 () {58 vars in 1134 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:02.363571 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:02.364737 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:02.365175 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:02.366056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:02.366515 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:02.366971 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:02.376356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-51b3ce2b-fc25-4e34-be3f-02f0550ec355 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c805eee0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.477179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-51b3ce2b-fc25-4e34-be3f-02f0550ec355 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104490 Aug 05 19:57:02.477986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 456/899] 10.222.0.86 () {58 vars in 1167 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:02.483963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.485079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:02.495916 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:02.497686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:02.498161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:02.499000 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:02.499488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:02.499940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:02.538708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:02.539525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:02.540175 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:02.540857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lazy-loading 'fault' on Instance uuid 575d8948-a40b-4af4-bff2-7e36cf37d5ce {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:57:02.553734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:02.564005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5298ffe9-68e4-49e5-90d0-23b95436648c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.218348 Aug 05 19:57:02.574892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 444/900] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:02.581712 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-57ddd672-a28b-49d3-a006-a2ccb5011e37 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c8112310>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.592820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb77bfeec5c14d6db3f7a5eb71a6d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5122857f764dcf977389f772000b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:02.601374 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7c675bfb-44d3-4f42-af10-b23442269aa0 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 200 len: 1305 microversion: 2.1 time: 0.122059 Aug 05 19:57:02.601959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 457/901] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:02.680429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-57ddd672-a28b-49d3-a006-a2ccb5011e37 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.103606 Aug 05 19:57:02.681289 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 445/902] 10.222.0.86 () {58 vars in 1170 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:02.694721 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2b33ee24-116c-4597-9073-3b9dcb015f7c tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c36d4ca0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.784858 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2b33ee24-116c-4597-9073-3b9dcb015f7c tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093995 Aug 05 19:57:02.785457 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 458/903] 10.222.0.86 () {58 vars in 1155 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:02.799466 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-de459ec0-144c-4468-b093-25382de2dca0 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c81399d0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.900029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-de459ec0-144c-4468-b093-25382de2dca0 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104612 Aug 05 19:57:02.900867 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 446/904] 10.222.0.86 () {58 vars in 1188 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:02.917265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9ca58998-f616-4e17-a48a-f4faf2145e56 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] Calling method '.version_select at 0x7f18c37838b0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:03.029387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:03.030327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:03.039078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:03.039904 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:03.040778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:03.042145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:03.042894 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:03.043534 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:03.050789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9ca58998-f616-4e17-a48a-f4faf2145e56 tempest-VolumesTestJSON-1267286609 tempest-VolumesTestJSON-1267286609-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.140228 Aug 05 19:57:03.054668 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 459/905] 10.222.0.86 () {58 vars in 1155 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:03.210778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:03.219522 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:03.221033 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:03.222220 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ae01fac5-601f-4b32-bbb8-7e1f54137c90 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1730 microversion: 2.20 time: 0.197075 Aug 05 19:57:03.222814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 447/906] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:03 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:57:03.587692 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:03.588318 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:03.597639 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:03.598131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:03.598592 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:03.599953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:03.600417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:03.600842 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:03.625775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:03.626539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] [instance: 575d8948-a40b-4af4-bff2-7e36cf37d5ce] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:03.630347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:03.635543 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:03.636040 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:03.636484 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:03.637204 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:03.637672 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:03.638106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:03.655088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] HTTP exception thrown: Instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce could not be found. Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Request method failure captured: Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce HTTP/1.1 Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XXvPiauIxJC9LC-WFJz1Q9_nNw_2QMQKS6sRLIabgNhVwUrukSC5f-E5jefgKnlpQlfbicGjdv5srikl2fJTYFE9avNS-on-do68epQhcLrysBYyLb0sONfz6x-xT8uYIciVdpGhIv-wWUCHkKnlErcnfOfqePlDWdXzr6qEeIao4c Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 9a5122857f764dcf977389f772000b4e Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-VolumesNegativeTest-1088919765 Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:57:03.656697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9a5122857f764dcf977389f772000b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9a5122857f764dcf977389f772000b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9a5122857f764dcf977389f772000b4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9a5122857f764dcf977389f772000b4e"}]}] Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-VolumesNegativeTest-1088919765 Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 9a5122857f764dcf977389f772000b4e Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-VolumesNegativeTest-1088919765 Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-VolumesNegativeTest-1088919765-project Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: fb77bfeec5c14d6db3f7a5eb71a6d79f Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-VolumesNegativeTest-1088919765-project Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce could not be found. Aug 05 19:57:03.658243 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '575d8948-a40b-4af4-bff2-7e36cf37d5ce'} Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce could not be found. Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:03.659216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce could not be found. Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce could not be found. Aug 05 19:57:03.660429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:03.661581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] Returning 404 to user: Instance 575d8948-a40b-4af4-bff2-7e36cf37d5ce could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:03.661581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-78bb63fb-7e41-4fc1-ae5d-8dddd6c55246 tempest-VolumesNegativeTest-1088919765 tempest-VolumesNegativeTest-1088919765-project] 10.222.0.86 "GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce" status: 404 len: 111 microversion: 2.1 time: 0.036373 Aug 05 19:57:03.661581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 448/907] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:03 2022] GET /compute/v2.1/servers/575d8948-a40b-4af4-bff2-7e36cf37d5ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 19:57:03.763632 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:03.773481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-85a9064d-76ee-4b52-91ba-4017f1ef6267 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.190913 Aug 05 19:57:03.774124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 460/908] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:03 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:04.248313 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:04.248996 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:04.255766 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:04.256263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:04.256706 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:04.257445 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:04.257890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:04.258312 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:04.421728 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:04.432555 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:04.434138 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:04.435375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-811e7a9f-5b88-4b51-a182-62ad7c6139d6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1717 microversion: 2.20 time: 0.191826 Aug 05 19:57:04.435935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 449/909] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:04 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1717 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:04.796253 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:04.796875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:04.804114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:04.804642 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:04.805311 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:04.806031 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:04.806536 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:04.806949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:04.971074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:04.979661 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-516be7cf-9a2e-4110-a30d-2928c99fe424 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.187360 Aug 05 19:57:04.980580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 461/910] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:04 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:06.005700 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:06.006528 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:06.021498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:06.021498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:06.021498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:06.021498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:06.022712 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:06.022712 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:06.187430 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:06.196497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a5cae47e-3176-4252-8333-14fe88e6696a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.195417 Aug 05 19:57:06.197766 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 450/911] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:05 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:06.399206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:06.399812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:06.406822 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:06.407318 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:06.407753 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:06.408458 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:06.408909 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:06.409333 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:06.437491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8df60f8e-c824-45c2-b133-f61548cfa046 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/ips" status: 200 len: 149 microversion: 2.1 time: 0.042642 Aug 05 19:57:06.438081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 462/912] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:57:06 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:07.219951 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:07.220614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:07.227789 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:07.228297 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:07.228713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:07.229428 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:07.229887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:07.230315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:07.414299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:07.423666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-faa430aa-3947-467d-8c17-26ba5048637c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.207576 Aug 05 19:57:07.424388 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 451/913] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:07 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:07.864436 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0117142-61ee-4198-a36b-f7683d05394d"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:07.868216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:07.875699 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:07.876371 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:07.876813 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:07.877711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:07.878137 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:07.878958 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:08.192826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f12380de-82f6-4933-83f9-1e04f85b21d3 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "POST /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332613 Aug 05 19:57:08.193714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 463/914] 10.222.0.86 () {60 vars in 1323 bytes} [Fri Aug 5 19:57:07 2022] POST /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:08.446607 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:08.447702 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:08.455299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:08.456022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:08.456911 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:08.458528 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:08.459649 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:08.460087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:08.645067 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:08.654585 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f6f88dea-a8b4-4fe5-af12-c220caf3aaaa tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.212833 Aug 05 19:57:08.655306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 452/915] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:08 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:09.683109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:09.685752 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:09.703975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:09.703975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:09.703975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:09.703975 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:09.704476 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:09.704476 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:09.882297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:09.891025 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-657abf5e-f1c6-43d0-9a93-dda495db5df4 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.216056 Aug 05 19:57:09.892267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 464/916] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:09 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:10.913791 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:10.914579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:10.921192 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:10.921679 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:10.922428 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:10.923093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:10.923552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:10.924172 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:11.188835 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:11.205716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-60c34027-f735-4a7a-a7f1-a9e3ced0f85a tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.296051 Aug 05 19:57:11.206915 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 453/917] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:10 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:12.232312 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:12.234199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:12.248115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:12.252349 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:12.253935 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:12.256407 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:12.258878 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:12.259824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:12.548897 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:12.561419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-586032a7-059f-4503-bab7-df9fab0668d9 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.337837 Aug 05 19:57:12.564580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 465/918] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:12 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:13.586519 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:13.587770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:13.601772 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:13.602276 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:13.619333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:13.619333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:13.619333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:13.619333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:13.860668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:13.875147 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-edd85252-04da-4986-8eba-b30b547bcb22 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1757 microversion: 2.1 time: 0.293611 Aug 05 19:57:13.876318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 454/919] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:13 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1757 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:14.919259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:14.919259 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:14.942459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:14.942999 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:14.943448 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:14.946596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:14.947113 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:14.947557 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:15.159307 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:15.171080 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f49cf7e5-7814-476b-aacc-97aa1373435b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1760 microversion: 2.1 time: 0.275730 Aug 05 19:57:15.171361 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 466/920] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:14 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1760 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:16.084055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:16.084679 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:16.091078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:16.091806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:16.092246 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:16.093159 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:16.093633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:16.094104 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:16.109912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:16.187890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lazy-loading 'services' on Instance uuid 280a9bf9-043d-4a47-8a35-f184de29c2b0 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:57:16.271209 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-846339ab-1d38-4dc2-8b00-0176c0043a44 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments/a0117142-61ee-4198-a36b-f7683d05394d" status: 202 len: 0 microversion: 2.1 time: 0.190440 Aug 05 19:57:16.272274 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 455/921] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:57:16 2022] DELETE /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments/a0117142-61ee-4198-a36b-f7683d05394d => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:57:16.287666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:16.293228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:16.300204 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=66 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:16.308687 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:16.309710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:16.310236 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:16.311052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:16.311577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:16.312193 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:16.345896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5082f467-d15f-450c-a766-903c0c3a598b tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063325 Aug 05 19:57:16.351261 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 467/922] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:57:16 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:17.360791 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:17.371136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:17.378229 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:17.378804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:17.379289 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:17.380945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:17.381419 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:17.381883 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:17.435565 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-da5e3b14-b7d5-4274-a0be-5a5cadeb5fb2 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079960 Aug 05 19:57:17.437444 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 456/923] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:57:17 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:18.451110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:18.455557 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:18.468290 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:18.469023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:18.470212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:18.471326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:18.472028 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:18.472661 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:18.554199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-67006721-4c0d-42a2-ad24-20b45a5e167d tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108762 Aug 05 19:57:18.560986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 468/924] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:57:18 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:19.573602 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:19.576543 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:19.585660 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:19.586539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:19.586768 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:19.590002 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:19.590600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:19.591084 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:19.641818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c23553c4-1e92-4ea1-9477-183bcb3813e6 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074430 Aug 05 19:57:19.642753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 457/925] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:57:19 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 19:57:19.728116 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:19.728686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:19.740778 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:19.741619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:19.742189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:19.743470 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:19.743819 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:19.744348 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:19.791904 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Going to try to terminate instance {{(pid=124553) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:57:19.904946 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f82dc543-e298-419f-8069-2a4608620aaf tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 204 len: 0 microversion: 2.1 time: 0.177879 Aug 05 19:57:19.907101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 469/926] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:57:19 2022] DELETE /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:57:19.916735 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:19.917363 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:19.925584 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:19.926080 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:19.929832 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:19.932668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:19.933190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:19.933635 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:20.130678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:20.147582 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7e73dda3-6d8a-4918-9cbe-268331d2a299 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1682 microversion: 2.1 time: 0.235327 Aug 05 19:57:20.148353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 458/927] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:19 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:20.461003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8a9d4d9f-f121-4d6a-95b3-767c73f20f1e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Action: 'create', calling method: .version_select at 0x7f18c805e280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1274635914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFLHzfkxUdovsGTkpnQx5ppoKMsmYwkqdxSphO8a70FNxBrV+tw3h7cJWyxH2MTMYK5K6PjLnbJTfiscQ3c1tPIzW0V5nwI610f2bu8v4v7Q2i+/BoK7DuiD73Y9leq3A=="}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:20.484486 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-8a9d4d9f-f121-4d6a-95b3-767c73f20f1e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Getting quotas for project 7372aebdf6554202a45b0bbd7bad0700. Resources: {'key_pairs'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:57:20.491486 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-8a9d4d9f-f121-4d6a-95b3-767c73f20f1e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Getting quotas for user 19c2f15eb1644278b911cc50370da9b7 and project 7372aebdf6554202a45b0bbd7bad0700. Resources: {'key_pairs'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:57:20.524902 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8a9d4d9f-f121-4d6a-95b3-767c73f20f1e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.277286 Aug 05 19:57:20.525511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 470/928] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:57:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:21.169781 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:21.170367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:21.177556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:21.178039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:21.178686 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:21.179402 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:21.179864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:21.180294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:21.350806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:21.362104 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e2b22264-1da0-4819-a399-37672914e811 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1682 microversion: 2.1 time: 0.196707 Aug 05 19:57:21.370069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 459/929] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:21 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:22.385738 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:22.386649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:22.396436 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:22.398397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:22.399537 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:22.401893 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:22.402952 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:22.403893 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:22.511710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:22.613573 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a357a3d27e4e41adae1c56ee39ae5aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fbd8d38b743e9915a370d8f1d77c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:22.626582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-91cea40e-c1a8-44e8-bd4e-b93bfef1cd76 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 200 len: 1614 microversion: 2.1 time: 0.245642 Aug 05 19:57:22.636315 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 471/930] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:22 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 1614 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:22.901473 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-c91f94d5-6d6d-41ee-8037-f22b4024ff4c req-47e29b46-bee9-40a4-822e-078a8090e143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280a9bf9-043d-4a47-8a35-f184de29c2b0", "name": "network-vif-deleted", "tag": "30097b8f-4f15-4542-8438-fbe4d2dc888b"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:22.934948 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c91f94d5-6d6d-41ee-8037-f22b4024ff4c req-47e29b46-bee9-40a4-822e-078a8090e143 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:22.943400 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c91f94d5-6d6d-41ee-8037-f22b4024ff4c req-47e29b46-bee9-40a4-822e-078a8090e143 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:22.947356 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c91f94d5-6d6d-41ee-8037-f22b4024ff4c req-47e29b46-bee9-40a4-822e-078a8090e143 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:22.980046 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-c91f94d5-6d6d-41ee-8037-f22b4024ff4c req-47e29b46-bee9-40a4-822e-078a8090e143 service nova] Creating event network-vif-deleted:30097b8f-4f15-4542-8438-fbe4d2dc888b for instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 on hv-cinder-85220 Aug 05 19:57:22.985496 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-c91f94d5-6d6d-41ee-8037-f22b4024ff4c req-47e29b46-bee9-40a4-822e-078a8090e143 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087939 Aug 05 19:57:22.989809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 460/931] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:23.656527 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:23.659863 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:23.676370 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:23.682023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:23.684169 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:23.685667 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:23.686495 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:23.687262 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:23.710272 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 HTTP/1.1 Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:23.713227 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:23.714924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '280a9bf9-043d-4a47-8a35-f184de29c2b0'} Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:23.719248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:23.720610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:23.721973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:23.721973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1e5700cb-0d43-424a-abdc-9c767f22eacb tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 404 len: 111 microversion: 2.1 time: 0.069521 Aug 05 19:57:23.721973 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 472/932] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:23 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:23.729614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-90a0fca5-dff4-4c03-b838-5781bbee0506 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '.version_select at 0x7f18c8012af0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:23.754900 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-90a0fca5-dff4-4c03-b838-5781bbee0506 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917528476" status: 202 len: 0 microversion: 2.1 time: 0.031582 Aug 05 19:57:23.755662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 461/933] 10.222.0.86 () {58 vars in 1221 bytes} [Fri Aug 5 19:57:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917528476 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:57:25.704952 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:25.705547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:25.712711 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:25.713126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:25.713567 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:25.714321 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:25.714851 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:25.715284 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:25.729484 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 HTTP/1.1 Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:25.731186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.732754 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '280a9bf9-043d-4a47-8a35-f184de29c2b0'} Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:25.733643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.735110 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.736519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:25.736519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-79af384d-aef4-48e5-8fa2-f1e69f629ca0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 404 len: 111 microversion: 2.1 time: 0.032816 Aug 05 19:57:25.736519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 473/934] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:57:25 2022] DELETE /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:25.742462 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:25.743261 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 280a9bf9-043d-4a47-8a35-f184de29c2b0] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:25.750545 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:25.751088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:25.751519 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:25.752235 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:25.752693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:25.753117 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:25.767399 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 HTTP/1.1 Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:57:25.769027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.770767 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '280a9bf9-043d-4a47-8a35-f184de29c2b0'} Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:25.771732 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. Aug 05 19:57:25.773001 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:25.774069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 280a9bf9-043d-4a47-8a35-f184de29c2b0 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:25.774069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ffd20213-7e17-432e-a243-1044a8e8fd08 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0" status: 404 len: 111 microversion: 2.1 time: 0.033089 Aug 05 19:57:25.774069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 462/935] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:25 2022] GET /compute/v2.1/servers/280a9bf9-043d-4a47-8a35-f184de29c2b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:26.920125 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:26.921382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:26.929684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:26.930172 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:26.931211 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:26.932249 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:26.932879 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:26.933670 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:26.951143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 HTTP/1.1 Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:26.952843 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:26.954460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'acffbb62-5c10-4d55-ad26-3e31f8ade0e6'} Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:26.955578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:26.956911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:26.958963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:26.958963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-457c3cab-c198-4d68-82ab-84ca996cc68e tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 404 len: 111 microversion: 2.1 time: 0.039303 Aug 05 19:57:26.958963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 474/936] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:57:26 2022] DELETE /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 19:57:26.964761 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:26.965393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: acffbb62-5c10-4d55-ad26-3e31f8ade0e6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:26.975047 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:26.975326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:26.976260 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:26.977164 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:26.977741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:26.978182 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:26.998223 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 HTTP/1.1 Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:57:27.000409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:27.002011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'acffbb62-5c10-4d55-ad26-3e31f8ade0e6'} Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:27.002843 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. Aug 05 19:57:27.004280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.006901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance acffbb62-5c10-4d55-ad26-3e31f8ade0e6 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:27.007791 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-838705b3-a933-4c3c-9e35-a7488fad97dc tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6" status: 404 len: 111 microversion: 2.1 time: 0.048495 Aug 05 19:57:27.010673 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 463/937] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:26 2022] GET /compute/v2.1/servers/acffbb62-5c10-4d55-ad26-3e31f8ade0e6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:27.017087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:27.017591 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:27.024830 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:27.025312 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:27.025744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:27.026437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:27.026923 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:27.027352 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:27.044807 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e HTTP/1.1 Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:27.046373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.048037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '072224de-6d26-42c6-8b85-d68219c9cd8e'} Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:27.048800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.050418 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.053479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:27.053479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c9a1dbc3-30a3-4cb9-8955-c7cf562833c0 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 404 len: 111 microversion: 2.1 time: 0.035570 Aug 05 19:57:27.053479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 475/938] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:57:27 2022] DELETE /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:27.058837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:27.059926 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 072224de-6d26-42c6-8b85-d68219c9cd8e] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:27.065704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:27.066411 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:27.066887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:27.068221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:27.068734 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:27.069102 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:27.083721 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e HTTP/1.1 Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:57:27.085448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.087194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '072224de-6d26-42c6-8b85-d68219c9cd8e'} Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:27.088049 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. Aug 05 19:57:27.089253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:27.090322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 072224de-6d26-42c6-8b85-d68219c9cd8e could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:27.090322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ee6f4b6c-1138-41c1-b621-1c61408b2aec tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e" status: 404 len: 111 microversion: 2.1 time: 0.032736 Aug 05 19:57:27.090322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 464/939] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:27 2022] GET /compute/v2.1/servers/072224de-6d26-42c6-8b85-d68219c9cd8e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 19:57:28.256463 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:28.257016 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:28.264235 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:28.264783 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:28.265226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:28.265923 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:28.266376 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:28.266860 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:28.281255 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d HTTP/1.1 Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:28.282736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.284171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '0f41d629-ef18-4686-bf58-6b13e25fe71d'} Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:28.284927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.286729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.289730 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:28.291066 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-28cd5892-ed7d-4909-8914-02e560c993e1 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "DELETE /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 404 len: 111 microversion: 2.1 time: 0.038871 Aug 05 19:57:28.291910 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 476/940] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:57:28 2022] DELETE /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:28.300433 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:28.301226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] [instance: 0f41d629-ef18-4686-bf58-6b13e25fe71d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:28.310284 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:28.310744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:28.311447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:28.312344 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:28.313010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:28.313310 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:28.340184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] HTTP exception thrown: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Request method failure captured: Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d HTTP/1.1 Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRmBKq7U38n_GQDWUmR0NjkgXkTCtu4Gm0bCobB2uy66xCEcozlgMOgZQabD9MQy6O_Y7g02AwP8WElfUspa4rKhELnih51R_uhPhBOtCLTLNC_FP-35bnbFSPbgLwlpx5fn6h5okW7RBcgbJRfcCltbPUD1DVps0G9bqndb-I1VTE Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:57:28.342421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7f9fbd8d38b743e9915a370d8f1d77c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7f9fbd8d38b743e9915a370d8f1d77c4"}]}] Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7f9fbd8d38b743e9915a370d8f1d77c4 Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052085858 Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: a357a3d27e4e41adae1c56ee39ae5aa7 Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeNegativeTest-2052085858-project Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.344190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '0f41d629-ef18-4686-bf58-6b13e25fe71d'} Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:28.345039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. Aug 05 19:57:28.346333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:28.347564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] Returning 404 to user: Instance 0f41d629-ef18-4686-bf58-6b13e25fe71d could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:28.347564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b95a9d4b-4902-4509-bf0b-ca1433f10713 tempest-AttachVolumeNegativeTest-2052085858 tempest-AttachVolumeNegativeTest-2052085858-project] 10.222.0.86 "GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d" status: 404 len: 111 microversion: 2.1 time: 0.047827 Aug 05 19:57:28.351339 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 465/941] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:28 2022] GET /compute/v2.1/servers/0f41d629-ef18-4686-bf58-6b13e25fe71d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:35.600453 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=4 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:35.752787 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c0f4c570-94b6-432b-b41f-2d05cce9ad92 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Action: 'create', calling method: .version_select at 0x7f18c37b8ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1214557254"}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:36.244121 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c0f4c570-94b6-432b-b41f-2d05cce9ad92 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.648795 Aug 05 19:57:36.244937 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 477/942] 10.222.0.86 () {60 vars in 1155 bytes} [Fri Aug 5 19:57:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 650 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 19:57:36.261228 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a92381fc-5a5a-4501-9e94-f675bd307f61 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c800e280>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:36.337440 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a92381fc-5a5a-4501-9e94-f675bd307f61 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4" status: 200 len: 345 microversion: 2.1 time: 0.083531 Aug 05 19:57:36.338009 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 466/943] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:57:36 2022] GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:37.353217 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-cf3d71c8-524d-41c3-b202-686966e1dde5 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c8054790>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:37.409600 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-cf3d71c8-524d-41c3-b202-686966e1dde5 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4" status: 200 len: 346 microversion: 2.1 time: 0.062073 Aug 05 19:57:37.410814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 478/944] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:57:37 2022] GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:37.426103 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-cf088aa2-03b0-4c19-8ff9-17a5506b758f tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Action: 'create', calling method: .version_select at 0x7f18c8165f70>, body: {"snapshot": {"volume_id": "eac331b8-08c9-40ac-8e34-27aac9f926f4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1793548297"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:37.627908 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-cf088aa2-03b0-4c19-8ff9-17a5506b758f tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.206659 Aug 05 19:57:37.628570 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 467/945] 10.222.0.86 () {60 vars in 1162 bytes} [Fri Aug 5 19:57:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:37.640696 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1024bdba-bf31-4db9-b926-6b92d71e020b tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c37b8040>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:37.697912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1024bdba-bf31-4db9-b926-6b92d71e020b tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0" status: 200 len: 287 microversion: 2.1 time: 0.061681 Aug 05 19:57:37.698841 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 479/946] 10.222.0.86 () {58 vars in 1251 bytes} [Fri Aug 5 19:57:37 2022] GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:37.711123 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-ed5868cd-f700-4084-8b34-dc925c3eecfe tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c8374550>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:37.757622 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-ed5868cd-f700-4084-8b34-dc925c3eecfe tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.052006 Aug 05 19:57:37.758216 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 468/947] 10.222.0.86 () {58 vars in 1140 bytes} [Fri Aug 5 19:57:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:37.771004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-93e1e730-9025-409a-aaba-09fd617d4f04 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c36fef70>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:37.806503 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-93e1e730-9025-409a-aaba-09fd617d4f04 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0" status: 200 len: 287 microversion: 2.1 time: 0.041079 Aug 05 19:57:37.807616 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 480/948] 10.222.0.86 () {58 vars in 1251 bytes} [Fri Aug 5 19:57:37 2022] GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:38.643927 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:38.647560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:38.656817 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-776477954", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1274635914", "security_groups": [{"name": "tempest-secgroup-smoke-493261908"}], "block_device_mapping_v2": [{"uuid": "f9c8ef05-db8d-464b-82be-3f7ec7e1a90a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "502545db-6859-4120-9256-0caba07649d2"}]}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:38.819764 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4b951e34-5ddb-4e5b-b11b-7196992ee1f7 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c3783670>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:38.827598 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:38.829279 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=12 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:38.871038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4b951e34-5ddb-4e5b-b11b-7196992ee1f7 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0" status: 200 len: 287 microversion: 2.1 time: 0.055253 Aug 05 19:57:38.871939 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 481/949] 10.222.0.86 () {58 vars in 1251 bytes} [Fri Aug 5 19:57:38 2022] GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:38.883729 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] validate_networks() for [('502545db-6859-4120-9256-0caba07649d2', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:57:39.458763 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:57:39.459488 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:57:39.460202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:57:39.460820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:57:39.461426 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:57:39.475354 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:39.476187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:39.476846 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:39.477884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:39.478581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:39.479506 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:39.500074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Getting quotas for project 7372aebdf6554202a45b0bbd7bad0700. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:57:39.507562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Getting quotas for user 19c2f15eb1644278b911cc50370da9b7 and project 7372aebdf6554202a45b0bbd7bad0700. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:57:39.588282 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:57:39.590506 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9c8ef05-db8d-464b-82be-3f7ec7e1a90a',volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:57:39.755863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-01960063-d8b7-47c1-b5d4-350b41c7ca58 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.112713 Aug 05 19:57:39.757062 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 469/950] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:57:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:57:39.768764 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b4564c3d-b170-4276-a90f-3c26b0b108cf tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:39.771257 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b4564c3d-b170-4276-a90f-3c26b0b108cf tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:39.885568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-813cc5c7-2170-49ae-9cd8-263bfd499eb6 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c81e8c10>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:39.951627 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-813cc5c7-2170-49ae-9cd8-263bfd499eb6 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0" status: 200 len: 287 microversion: 2.1 time: 0.069414 Aug 05 19:57:39.953105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 470/951] 10.222.0.86 () {58 vars in 1251 bytes} [Fri Aug 5 19:57:39 2022] GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:40.218529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b4564c3d-b170-4276-a90f-3c26b0b108cf tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:40.227906 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b4564c3d-b170-4276-a90f-3c26b0b108cf tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1094 microversion: 2.1 time: 0.463412 Aug 05 19:57:40.228980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 482/952] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:39 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1094 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:57:40.761479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-feb72120-f332-4316-a3c8-14c4350bf985 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Action: 'create', calling method: .version_select at 0x7f18c814e820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1975071092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5cx+zCt6yC4jabD9J1RuB6L6cE9fEhuYkDoNHbVE+yS3enyIu5l1UU1N4p/UhooH9Vk52N+fjgr4KiemqOYA+Xam3aBqsv8Fc1M58uj/y+aZYbofzvygzOUlFif3F7ig=="}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:40.780131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-feb72120-f332-4316-a3c8-14c4350bf985 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Getting quotas for project 47ea1b6ed7d647b8987e6c128248cab6. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:57:40.788558 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-feb72120-f332-4316-a3c8-14c4350bf985 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Getting quotas for user 802ed5c51d184f6c925f31ab6020ac93 and project 47ea1b6ed7d647b8987e6c128248cab6. Resources: {'key_pairs'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:57:40.813367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-feb72120-f332-4316-a3c8-14c4350bf985 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.258219 Aug 05 19:57:40.819915 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 471/953] 10.222.0.86 () {60 vars in 1159 bytes} [Fri Aug 5 19:57:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:40.966163 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a1b545e2-29d9-40b2-a231-8916fe997dc5 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c8054af0>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:41.007769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a1b545e2-29d9-40b2-a231-8916fe997dc5 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0" status: 200 len: 288 microversion: 2.1 time: 0.045418 Aug 05 19:57:41.008344 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 483/954] 10.222.0.86 () {58 vars in 1251 bytes} [Fri Aug 5 19:57:40 2022] GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:41.021395 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-323a48cd-62ed-44fe-9526-0714e7c71390 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c8012940>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:41.104798 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-323a48cd-62ed-44fe-9526-0714e7c71390 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "DELETE /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0" status: 202 len: 0 microversion: 2.1 time: 0.088456 Aug 05 19:57:41.109179 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 472/955] 10.222.0.86 () {58 vars in 1254 bytes} [Fri Aug 5 19:57:41 2022] DELETE /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:57:41.117812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2356ff01-6c99-4fd0-909d-11bc26bd4a04 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c80dec10>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:41.169706 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2356ff01-6c99-4fd0-909d-11bc26bd4a04 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0" status: 200 len: 287 microversion: 2.1 time: 0.059151 Aug 05 19:57:41.170409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 484/956] 10.222.0.86 () {58 vars in 1251 bytes} [Fri Aug 5 19:57:41 2022] GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:57:41.253066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:41.269342 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:41.281071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:41.282354 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:41.282925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:41.288650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:41.289654 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:41.290486 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:41.438245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:41.451202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-8d3d5eda-577e-465c-9d27-2c6d9881aede tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1210 microversion: 2.1 time: 0.204832 Aug 05 19:57:41.452235 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 473/957] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:41 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1210 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:42.189782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-70f3329e-b40a-4c2e-841f-cd0cc528facd tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c36d4430>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:42.244458 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-70f3329e-b40a-4c2e-841f-cd0cc528facd tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] HTTP exception thrown: Snapshot d3717ab4-c13b-43bb-8712-156c6dc890d0 could not be found. Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-70f3329e-b40a-4c2e-841f-cd0cc528facd tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Request method failure captured: Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 HTTP/1.1 Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XYvdQq4L6wVKbXMcCXecLqp5BnJasE1t4tzR79bXvsPRtbC30fFVM8_V3741KU_7gQI1V1XBZ5uzaU4lzX9QTTo5kGxnDr_omSxtPFSaBOVYy2H7R4fypR9a2ppU8RMmx0FlCpvCJMz0rRY_cjyBOZq4v0q96TM7CYUBir7x5brxfI Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: eb51bc2bb5ba4a018af6f83ea1d95112 Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:42.246749 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/eb51bc2bb5ba4a018af6f83ea1d95112"}]}] Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: eb51bc2bb5ba4a018af6f83ea1d95112 Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesSnapshotsTestJSON-1357862290-project Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 8a68ac1cfb2e4b80a69d489780323f01 Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1357862290-project Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Snapshot d3717ab4-c13b-43bb-8712-156c6dc890d0 could not be found. Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'd3717ab4-c13b-43bb-8712-156c6dc890d0'} Aug 05 19:57:42.248224 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d3717ab4-c13b-43bb-8712-156c6dc890d0 could not be found. (HTTP 404) (Request-ID: req-e04ac126-ac64-4929-b55d-992256a59aae) Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:42.249164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:57:42.250469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d3717ab4-c13b-43bb-8712-156c6dc890d0 could not be found. Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 19:57:42.251799 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d3717ab4-c13b-43bb-8712-156c6dc890d0 could not be found. Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d3717ab4-c13b-43bb-8712-156c6dc890d0 could not be found. Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-70f3329e-b40a-4c2e-841f-cd0cc528facd tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Returning 404 to user: Snapshot d3717ab4-c13b-43bb-8712-156c6dc890d0 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:42.254501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-70f3329e-b40a-4c2e-841f-cd0cc528facd tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0" status: 404 len: 111 microversion: 2.1 time: 0.072946 Aug 05 19:57:42.262422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-df0c84b9-0b60-46a9-b3f7-37614bbcfd40 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c8165dc0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:42.273293 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 485/958] 10.222.0.86 () {58 vars in 1251 bytes} [Fri Aug 5 19:57:42 2022] GET /compute/v2.1/os-snapshots/d3717ab4-c13b-43bb-8712-156c6dc890d0 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:42.375778 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-df0c84b9-0b60-46a9-b3f7-37614bbcfd40 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4" status: 202 len: 0 microversion: 2.1 time: 0.118007 Aug 05 19:57:42.376416 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 474/959] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:57:42 2022] DELETE /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:57:42.385652 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8d08a7be-e0b6-49c9-992f-3c4dcfbe4808 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c8054820>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:42.480475 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:42.481516 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:42.490160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:42.492836 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:42.495113 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:42.500381 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:42.501759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:42.503404 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:42.593155 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8d08a7be-e0b6-49c9-992f-3c4dcfbe4808 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4" status: 200 len: 345 microversion: 2.1 time: 0.211408 Aug 05 19:57:42.593758 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 486/960] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:57:42 2022] GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 => generated 345 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:42.819831 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:42.830387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fc4399ae-ff8f-4df7-a987-d6fc89f42596 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.358867 Aug 05 19:57:42.841562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 475/961] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:42 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:57:43.129153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:43.132567 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:43.139549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.140049 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.140545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:43.141291 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.141721 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.142191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:43.190454 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dcb56783-b5f9-41ab-aa47-db358cd1125e tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065909 Aug 05 19:57:43.191828 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 487/962] 10.222.0.86 () {60 vars in 1343 bytes} [Fri Aug 5 19:57:43 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:43.270119 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:43.272823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:43.279998 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.280724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.281320 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:43.282349 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.282989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.283578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:43.315705 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:57:43.417954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5369df93-477b-4781-9872-afe8842cfe2d tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 204 len: 0 microversion: 2.20 time: 0.151431 Aug 05 19:57:43.418466 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 476/963] 10.222.0.86 () {60 vars in 1280 bytes} [Fri Aug 5 19:57:43 2022] DELETE /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 19:57:43.426817 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-d989c797-bc99-4ee5-a4e9-40c2eadf551f req-93acf499-046c-4a42-8d37-6332c4d74385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eae3e8f-bb1f-4494-9e2a-059754aaee19", "tag": "110c0e28-cb8c-4611-86c6-904d92cb1cae"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:43.435094 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:43.435931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:43.442393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.443920 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.445087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:43.446050 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.446847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.447504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:43.454692 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-d989c797-bc99-4ee5-a4e9-40c2eadf551f req-93acf499-046c-4a42-8d37-6332c4d74385 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.455189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-d989c797-bc99-4ee5-a4e9-40c2eadf551f req-93acf499-046c-4a42-8d37-6332c4d74385 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.455761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-d989c797-bc99-4ee5-a4e9-40c2eadf551f req-93acf499-046c-4a42-8d37-6332c4d74385 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:43.468245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-d989c797-bc99-4ee5-a4e9-40c2eadf551f req-93acf499-046c-4a42-8d37-6332c4d74385 service nova] Creating event network-changed:110c0e28-cb8c-4611-86c6-904d92cb1cae for instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 on hv-cinder-85220 Aug 05 19:57:43.473792 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-d989c797-bc99-4ee5-a4e9-40c2eadf551f req-93acf499-046c-4a42-8d37-6332c4d74385 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053249 Aug 05 19:57:43.483067 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 488/964] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:43.607318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:43.608404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b502fc17-b683-4d6a-a0af-3371e0bff378 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c81d5b80>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:43.617279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:43.619158 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:43.620377 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-6d3cdbcf-9d3a-4e67-a462-42be211bc1ce tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.191818 Aug 05 19:57:43.620934 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 477/965] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:43 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:57:43.638394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-b502fc17-b683-4d6a-a0af-3371e0bff378 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] HTTP exception thrown: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b502fc17-b683-4d6a-a0af-3371e0bff378 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Request method failure captured: Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 HTTP/1.1 Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XYvdQq4L6wVKbXMcCXecLqp5BnJasE1t4tzR79bXvsPRtbC30fFVM8_V3741KU_7gQI1V1XBZ5uzaU4lzX9QTTo5kGxnDr_omSxtPFSaBOVYy2H7R4fypR9a2ppU8RMmx0FlCpvCJMz0rRY_cjyBOZq4v0q96TM7CYUBir7x5brxfI Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: eb51bc2bb5ba4a018af6f83ea1d95112 Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:43.640502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/eb51bc2bb5ba4a018af6f83ea1d95112"}]}] Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: eb51bc2bb5ba4a018af6f83ea1d95112 Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesSnapshotsTestJSON-1357862290-project Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 8a68ac1cfb2e4b80a69d489780323f01 Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1357862290-project Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'eac331b8-08c9-40ac-8e34-27aac9f926f4'} Aug 05 19:57:43.642165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. (HTTP 404) (Request-ID: req-9323873d-0dc9-422b-a4e1-82266fed6b0d) Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.643148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:57:43.644655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 19:57:43.647145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b502fc17-b683-4d6a-a0af-3371e0bff378 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Returning 404 to user: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b502fc17-b683-4d6a-a0af-3371e0bff378 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4" status: 404 len: 109 microversion: 2.1 time: 0.037767 Aug 05 19:57:43.649051 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 489/966] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:57:43 2022] GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 19:57:43.659858 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0b606db3-8af2-4617-bb4e-662fc452ec80 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c81e8af0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:43.690247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-0b606db3-8af2-4617-bb4e-662fc452ec80 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] HTTP exception thrown: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0b606db3-8af2-4617-bb4e-662fc452ec80 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Request method failure captured: Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: DELETE /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 HTTP/1.1 Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XYvdQq4L6wVKbXMcCXecLqp5BnJasE1t4tzR79bXvsPRtbC30fFVM8_V3741KU_7gQI1V1XBZ5uzaU4lzX9QTTo5kGxnDr_omSxtPFSaBOVYy2H7R4fypR9a2ppU8RMmx0FlCpvCJMz0rRY_cjyBOZq4v0q96TM7CYUBir7x5brxfI Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: eb51bc2bb5ba4a018af6f83ea1d95112 Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:57:43.692427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/eb51bc2bb5ba4a018af6f83ea1d95112"}]}] Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: eb51bc2bb5ba4a018af6f83ea1d95112 Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-VolumesSnapshotsTestJSON-1357862290-project Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 8a68ac1cfb2e4b80a69d489780323f01 Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1357862290-project Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'eac331b8-08c9-40ac-8e34-27aac9f926f4'} Aug 05 19:57:43.694586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. (HTTP 404) (Request-ID: req-0a06d2e8-cdea-495b-a74d-e3a1ba809180) Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.695646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 19:57:43.697155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 19:57:43.698617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0b606db3-8af2-4617-bb4e-662fc452ec80 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Returning 404 to user: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0b606db3-8af2-4617-bb4e-662fc452ec80 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4" status: 404 len: 109 microversion: 2.1 time: 0.039023 Aug 05 19:57:43.699992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 478/967] 10.222.0.86 () {58 vars in 1248 bytes} [Fri Aug 5 19:57:43 2022] DELETE /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:57:43.703474 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f2310daa-8fd3-4d7c-8aa7-b17062501f42 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Calling method '.version_select at 0x7f18c8054b80>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:43.739063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-f2310daa-8fd3-4d7c-8aa7-b17062501f42 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] HTTP exception thrown: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f2310daa-8fd3-4d7c-8aa7-b17062501f42 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Request method failure captured: Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 HTTP/1.1 Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XYvdQq4L6wVKbXMcCXecLqp5BnJasE1t4tzR79bXvsPRtbC30fFVM8_V3741KU_7gQI1V1XBZ5uzaU4lzX9QTTo5kGxnDr_omSxtPFSaBOVYy2H7R4fypR9a2ppU8RMmx0FlCpvCJMz0rRY_cjyBOZq4v0q96TM7CYUBir7x5brxfI Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: eb51bc2bb5ba4a018af6f83ea1d95112 Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:43.741994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_eb51bc2bb5ba4a018af6f83ea1d95112"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/eb51bc2bb5ba4a018af6f83ea1d95112"}]}] Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: eb51bc2bb5ba4a018af6f83ea1d95112 Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1357862290 Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesSnapshotsTestJSON-1357862290-project Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 8a68ac1cfb2e4b80a69d489780323f01 Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1357862290-project Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'eac331b8-08c9-40ac-8e34-27aac9f926f4'} Aug 05 19:57:43.743835 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. (HTTP 404) (Request-ID: req-af201bce-bc07-4ac8-a08e-7ff281961d9f) Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.744719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 19:57:43.745853 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 19:57:43.747148 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f2310daa-8fd3-4d7c-8aa7-b17062501f42 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] Returning 404 to user: Volume eac331b8-08c9-40ac-8e34-27aac9f926f4 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f2310daa-8fd3-4d7c-8aa7-b17062501f42 tempest-VolumesSnapshotsTestJSON-1357862290 tempest-VolumesSnapshotsTestJSON-1357862290-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4" status: 404 len: 109 microversion: 2.1 time: 0.043742 Aug 05 19:57:43.749554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 490/968] 10.222.0.86 () {58 vars in 1245 bytes} [Fri Aug 5 19:57:43 2022] GET /compute/v2.1/os-volumes/eac331b8-08c9-40ac-8e34-27aac9f926f4 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 19:57:43.853955 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:43.854572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:43.861309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.862019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.862671 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:43.863376 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:43.863837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:43.864276 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:44.008314 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:44.016238 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-bbc4b439-5ed4-49a7-b92e-7a96f1dc8426 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.166171 Aug 05 19:57:44.016894 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 479/969] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:43 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:44.645539 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:44.646827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:44.653402 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:44.654128 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:44.654795 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:44.655680 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:44.656170 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:44.656614 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:44.812114 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:44.821115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:44.825852 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:44.830979 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1c864630-83bd-4da6-93b9-fe540ad600fd tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.189790 Aug 05 19:57:44.831971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 491/970] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:44 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:45.039025 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:45.039847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:45.046200 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:45.046979 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:45.047580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:45.048448 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:45.049090 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:45.049806 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:45.307453 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:45.317335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-70908b56-a4f5-4d65-9fa3-79b93d19faae tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.282943 Aug 05 19:57:45.323160 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 480/971] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:45 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:45.860785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:45.861930 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:45.873712 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:45.877042 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:45.877596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:45.878419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:45.887353 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:45.887946 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:46.213786 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:46.224992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:46.227694 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:46.234980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-33507313-a35c-49d1-b7aa-8201084648ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1723 microversion: 2.20 time: 0.382506 Aug 05 19:57:46.258100 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 492/972] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:45 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:57:46.355258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:46.356452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:46.365633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:46.366538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:46.367721 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:46.368820 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:46.369808 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:46.377106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:46.769617 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-3fb6c21c-adb3-4b2d-9904-8cc0796d313e req-ef8d0359-8a23-4a9b-90cb-b3f420fdd9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9826c-1788-4efe-951b-1092fead7ea9", "name": "network-vif-deleted", "tag": "a01a901d-1174-4772-9aa0-c8525d67930c"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:46.789293 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-3fb6c21c-adb3-4b2d-9904-8cc0796d313e req-ef8d0359-8a23-4a9b-90cb-b3f420fdd9bb service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:46.790225 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-3fb6c21c-adb3-4b2d-9904-8cc0796d313e req-ef8d0359-8a23-4a9b-90cb-b3f420fdd9bb service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:46.790844 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-3fb6c21c-adb3-4b2d-9904-8cc0796d313e req-ef8d0359-8a23-4a9b-90cb-b3f420fdd9bb service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:46.828807 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:46.835503 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-3fb6c21c-adb3-4b2d-9904-8cc0796d313e req-ef8d0359-8a23-4a9b-90cb-b3f420fdd9bb service nova] Creating event network-vif-deleted:a01a901d-1174-4772-9aa0-c8525d67930c for instance cca9826c-1788-4efe-951b-1092fead7ea9 on hv-cinder-85220 Aug 05 19:57:46.839439 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d4817c7e-b496-42ed-8a8a-66987e9aaa11 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.498472 Aug 05 19:57:46.846994 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-3fb6c21c-adb3-4b2d-9904-8cc0796d313e req-ef8d0359-8a23-4a9b-90cb-b3f420fdd9bb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081877 Aug 05 19:57:46.850951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 493/973] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:46.854841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 481/974] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:46 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:47.263236 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:47.264666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:47.277907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:47.278927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:47.279588 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:47.280472 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:47.281106 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:47.281741 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:47.337702 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:47.338945 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:47.339705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:47.341546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lazy-loading 'fault' on Instance uuid cca9826c-1788-4efe-951b-1092fead7ea9 {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:57:47.408906 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:47.417364 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:47.418978 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7435928a74258af5478959bd939bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be735c81c7a41b8a482e8f72a71bdef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:47.424342 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-bebe4066-ffc5-4fd9-8460-0aa4840608ee tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 200 len: 1371 microversion: 2.20 time: 0.165375 Aug 05 19:57:47.436671 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 494/975] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:47 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:47.866071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:47.870490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:47.881816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:47.882443 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:47.883046 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:47.884424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:47.884782 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:47.885612 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:48.050221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:48.059865 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-25a838b9-22f0-4ddf-aa2a-ddb7950b7b19 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.201316 Aug 05 19:57:48.061035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 482/976] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:47 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:48.448751 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:48.449429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:48.456029 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:48.456629 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:48.457195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:48.457949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:48.458575 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:48.459140 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:48.473677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] HTTP exception thrown: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Request method failure captured: Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 HTTP/1.1 Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRh8A8i6Fh3JQOfW_QUavC-2gH1K1i44JdIYaNCprqW1UVgmvyIYiRbzVdRahxnPEVfpvRzXuatk7smRskh26JJUhKrJk_vjw1h7RHFEDgFlhIuY_STsQjN4NyTXyPrbr_YrRYWpR0QP45p5GlzggjGadVcxXVlOcakcAYlNL6AbBg Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:48.475483 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}] Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: e8f7435928a74258af5478959bd939bb Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:48.476949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'cca9826c-1788-4efe-951b-1092fead7ea9'} Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:48.477816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:48.479212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:48.480326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Returning 404 to user: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:48.480326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-08656c68-6671-47e0-9cec-b3d1d6aae0a6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 404 len: 111 microversion: 2.20 time: 0.032635 Aug 05 19:57:48.480326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 495/977] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:48 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 19:57:48.486149 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2ae4979a-b8b9-4f34-9b08-3d01545c31b6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '.version_select at 0x7f18c8374700>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:48.508014 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2ae4979a-b8b9-4f34-9b08-3d01545c31b6 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993786936" status: 204 len: 0 microversion: 2.20 time: 0.025894 Aug 05 19:57:48.508864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 483/978] 10.222.0.86 () {60 vars in 1262 bytes} [Fri Aug 5 19:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993786936 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 19:57:49.082766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:49.084631 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:49.091506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:49.092145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:49.095088 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:49.096212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:49.096894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:49.097548 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:49.353785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:49.361989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2718c706-8fa1-4f24-97bf-5fece8bc4fce tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.284062 Aug 05 19:57:49.362546 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 496/979] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:49 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:50.387537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:50.392116 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:50.392754 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:50.404050 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:50.404753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:50.405205 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:50.406526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:50.407118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:50.407560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:50.614231 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:50.622854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0274d93a-2704-4644-85e1-4f938705ffaa tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.237312 Aug 05 19:57:50.624211 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 484/980] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:50 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:50.772740 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:50.777060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:50.777657 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:50.784191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:50.784677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:50.785115 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:50.785813 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:50.786268 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:50.786722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:50.801777 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] HTTP exception thrown: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Request method failure captured: Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 HTTP/1.1 Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRh8A8i6Fh3JQOfW_QUavC-2gH1K1i44JdIYaNCprqW1UVgmvyIYiRbzVdRahxnPEVfpvRzXuatk7smRskh26JJUhKrJk_vjw1h7RHFEDgFlhIuY_STsQjN4NyTXyPrbr_YrRYWpR0QP45p5GlzggjGadVcxXVlOcakcAYlNL6AbBg Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:50.804310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}] Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: e8f7435928a74258af5478959bd939bb Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.806359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'cca9826c-1788-4efe-951b-1092fead7ea9'} Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:50.807334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.809186 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.811160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Returning 404 to user: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:50.811160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6e9e691a-0c38-4ef1-a267-f1862e59b441 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 404 len: 111 microversion: 2.20 time: 0.034720 Aug 05 19:57:50.811160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 497/981] 10.222.0.86 () {60 vars in 1280 bytes} [Fri Aug 5 19:57:50 2022] DELETE /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 19:57:50.819308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:50.820056 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: cca9826c-1788-4efe-951b-1092fead7ea9] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:50.822204 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=10 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:50.827939 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:50.828525 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:50.828975 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:50.829691 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:50.830152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:50.830590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:50.844953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] HTTP exception thrown: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Request method failure captured: Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 HTTP/1.1 Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRh8A8i6Fh3JQOfW_QUavC-2gH1K1i44JdIYaNCprqW1UVgmvyIYiRbzVdRahxnPEVfpvRzXuatk7smRskh26JJUhKrJk_vjw1h7RHFEDgFlhIuY_STsQjN4NyTXyPrbr_YrRYWpR0QP45p5GlzggjGadVcxXVlOcakcAYlNL6AbBg Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:57:50.846568 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}] Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: e8f7435928a74258af5478959bd939bb Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.848267 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'cca9826c-1788-4efe-951b-1092fead7ea9'} Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:50.850226 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. Aug 05 19:57:50.851989 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:50.853444 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Returning 404 to user: Instance cca9826c-1788-4efe-951b-1092fead7ea9 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:50.853444 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2a00f791-1e9c-4b2f-83a2-c4303294a476 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9" status: 404 len: 111 microversion: 2.20 time: 0.033602 Aug 05 19:57:50.853444 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 485/982] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:50 2022] GET /compute/v2.1/servers/cca9826c-1788-4efe-951b-1092fead7ea9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 19:57:51.645100 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:51.645826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:51.652203 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:51.652796 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:51.653442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:51.654218 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:51.654834 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:51.655331 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:51.821239 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:51.830274 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3d67a7de-a085-4070-adf4-3f7ff0bfef7b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.189116 Aug 05 19:57:51.830885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 498/983] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:51 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:52.006054 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:52.006765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:52.013434 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:52.013925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:52.014393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:52.015157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:52.015611 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:52.016039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:52.031987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] HTTP exception thrown: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Request method failure captured: Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: DELETE /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 HTTP/1.1 Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XRh8A8i6Fh3JQOfW_QUavC-2gH1K1i44JdIYaNCprqW1UVgmvyIYiRbzVdRahxnPEVfpvRzXuatk7smRskh26JJUhKrJk_vjw1h7RHFEDgFlhIuY_STsQjN4NyTXyPrbr_YrRYWpR0QP45p5GlzggjGadVcxXVlOcakcAYlNL6AbBg Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:57:52.033559 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}] Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: e8f7435928a74258af5478959bd939bb Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.035552 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '096fbbf4-4d8a-4e2a-aa55-118994138c19'} Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:52.036697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.038733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.040202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Returning 404 to user: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:52.040202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5522c8a8-8eb7-431e-9502-c7240d82a966 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "DELETE /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 404 len: 111 microversion: 2.20 time: 0.033773 Aug 05 19:57:52.040202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 486/984] 10.222.0.86 () {60 vars in 1280 bytes} [Fri Aug 5 19:57:52 2022] DELETE /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 19:57:52.045734 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:52.046355 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] [instance: 096fbbf4-4d8a-4e2a-aa55-118994138c19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:52.052804 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:52.053561 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:52.054459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:52.055214 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:52.055669 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:52.056137 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:52.071705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] HTTP exception thrown: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Request method failure captured: Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 HTTP/1.1 Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XRh8A8i6Fh3JQOfW_QUavC-2gH1K1i44JdIYaNCprqW1UVgmvyIYiRbzVdRahxnPEVfpvRzXuatk7smRskh26JJUhKrJk_vjw1h7RHFEDgFlhIuY_STsQjN4NyTXyPrbr_YrRYWpR0QP45p5GlzggjGadVcxXVlOcakcAYlNL6AbBg Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:57:52.073199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9be735c81c7a41b8a482e8f72a71bdef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9be735c81c7a41b8a482e8f72a71bdef"}]}] Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 9be735c81c7a41b8a482e8f72a71bdef Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1699635247 Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: e8f7435928a74258af5478959bd939bb Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1699635247-project Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.074809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '096fbbf4-4d8a-4e2a-aa55-118994138c19'} Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:52.075866 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. Aug 05 19:57:52.077073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:57:52.078166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] Returning 404 to user: Instance 096fbbf4-4d8a-4e2a-aa55-118994138c19 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:52.078166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3df9c749-41d1-462f-8c2d-75d72c90b3c4 tempest-AttachVolumeShelveTestJSON-1699635247 tempest-AttachVolumeShelveTestJSON-1699635247-project] 10.222.0.86 "GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19" status: 404 len: 111 microversion: 2.20 time: 0.032857 Aug 05 19:57:52.078166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 499/985] 10.222.0.86 () {60 vars in 1277 bytes} [Fri Aug 5 19:57:52 2022] GET /compute/v2.1/servers/096fbbf4-4d8a-4e2a-aa55-118994138c19 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 19:57:52.854667 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:52.855514 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:52.865603 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:52.866494 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:52.867409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:52.868687 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:52.869403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:52.869819 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:53.136466 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:53.144403 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-595b2c4c-d85e-4310-b57d-64b99b7ffd1f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.294130 Aug 05 19:57:53.145271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 487/986] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:52 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:54.166101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:54.166906 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:54.174068 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:54.209578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:54.209578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:54.209578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:54.209578 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:54.210410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:54.374443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:54.384709 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1e308c49-2125-4f7d-9b95-e78916dd9d5b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.222385 Aug 05 19:57:54.385536 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 500/987] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:54 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:55.405598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:55.406221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:55.417153 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:55.417715 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:55.418165 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:55.419773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:55.420310 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:55.420753 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:55.708075 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:55.728678 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c723c2bc-993d-4fc2-b18a-82e6127112c0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.326588 Aug 05 19:57:55.728878 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 488/988] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:55 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:56.741908 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-b39c216e-4bf6-46af-b89b-949986213ded req-438a5f6c-c39f-4ff4-a289-3f212ee2eb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eae3e8f-bb1f-4494-9e2a-059754aaee19", "name": "network-vif-plugged", "status": "completed", "tag": "110c0e28-cb8c-4611-86c6-904d92cb1cae"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:56.755508 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:56.756532 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:56.769294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:56.772996 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:56.774720 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:56.775537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:56.785146 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:56.785619 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:56.788011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b39c216e-4bf6-46af-b89b-949986213ded req-438a5f6c-c39f-4ff4-a289-3f212ee2eb3b service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:56.788619 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b39c216e-4bf6-46af-b89b-949986213ded req-438a5f6c-c39f-4ff4-a289-3f212ee2eb3b service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:56.789504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b39c216e-4bf6-46af-b89b-949986213ded req-438a5f6c-c39f-4ff4-a289-3f212ee2eb3b service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:56.815986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-b39c216e-4bf6-46af-b89b-949986213ded req-438a5f6c-c39f-4ff4-a289-3f212ee2eb3b service nova] Creating event network-vif-plugged:110c0e28-cb8c-4611-86c6-904d92cb1cae for instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 on hv-cinder-85220 Aug 05 19:57:56.822085 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-b39c216e-4bf6-46af-b89b-949986213ded req-438a5f6c-c39f-4ff4-a289-3f212ee2eb3b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087993 Aug 05 19:57:56.822816 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 501/989] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:57:56.957145 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:56.984697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f889c97f-f452-4f6a-ab67-af893ba00220 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.219030 Aug 05 19:57:56.990981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 489/990] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:56 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:58.009622 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:58.010325 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:58.016656 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:58.017163 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:58.017588 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:58.018299 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:58.018824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:58.019281 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:58.166989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:58.174363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-e316b898-0177-45e5-a05b-0bfa8cce4d4d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1265 microversion: 2.1 time: 0.170182 Aug 05 19:57:58.174952 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 502/991] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:58 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:58.328905 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1253507927"}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:58.330098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:58.338362 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:58.338985 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:58.339438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:58.340218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:58.340741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:58.341121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:58.829363 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.network.security_group_api [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Removing security group ddf98b5b-ac2f-4b73-a14f-877322078f5b from port 34a60c93-aacf-4bba-8c03-257ef4588a08 Aug 05 19:57:59.205980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:59.209151 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:59.221404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:59.222489 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:59.225437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:59.226788 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:59.227981 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:59.228679 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:59.454294 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9fe2408b-3e7b-47e0-9446-65b8f3880061 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "POST /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/action" status: 202 len: 0 microversion: 2.1 time: 1.130496 Aug 05 19:57:59.459188 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 490/992] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 19:57:58 2022] POST /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:57:59.491074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1996478691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1975071092", "security_groups": [{"name": "tempest-secgroup-smoke-1987031175"}], "networks": [{"uuid": "53ecd74b-7287-4d33-85c7-df6b923a7ff7"}], "block_device_mapping_v2": [{"uuid": "bf63828b-1456-43eb-9b12-0b7dd5cba15b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:59.557158 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:57:59.571779 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8e002be3-a444-4165-87c2-f00da0ccae56 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1452 microversion: 2.1 time: 0.373995 Aug 05 19:57:59.572642 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 503/993] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:59 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1452 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:59.582863 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-19da0c00-d2b2-4ffd-ba0a-905ba0085888 req-0eb1e297-b54b-484d-bd36-f3c285580783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec295b92-6466-4366-ba60-1e1d50beb9d6", "tag": "34a60c93-aacf-4bba-8c03-257ef4588a08"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:59.630126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-19da0c00-d2b2-4ffd-ba0a-905ba0085888 req-0eb1e297-b54b-484d-bd36-f3c285580783 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:59.630739 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-19da0c00-d2b2-4ffd-ba0a-905ba0085888 req-0eb1e297-b54b-484d-bd36-f3c285580783 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:59.631703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-19da0c00-d2b2-4ffd-ba0a-905ba0085888 req-0eb1e297-b54b-484d-bd36-f3c285580783 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:59.651703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-19da0c00-d2b2-4ffd-ba0a-905ba0085888 req-0eb1e297-b54b-484d-bd36-f3c285580783 service nova] Creating event network-changed:34a60c93-aacf-4bba-8c03-257ef4588a08 for instance ec295b92-6466-4366-ba60-1e1d50beb9d6 on hv-cinder-85220 Aug 05 19:57:59.658124 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-19da0c00-d2b2-4ffd-ba0a-905ba0085888 req-0eb1e297-b54b-484d-bd36-f3c285580783 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083748 Aug 05 19:57:59.659167 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 504/994] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:59.674316 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:59.675074 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:57:59.689565 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:59.700460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:59.700921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:59.701673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:57:59.702138 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:57:59.702572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:57:59.799676 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] validate_networks() for [('53ecd74b-7287-4d33-85c7-df6b923a7ff7', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:58:00.103004 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:00.113643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-5639d6c1-bb57-46a1-9385-0903d6cc2fba tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1452 microversion: 2.1 time: 0.452304 Aug 05 19:58:00.114288 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 505/995] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:57:59 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1452 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:01.110299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:58:01.110894 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:58:01.111368 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:58:01.111781 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:58:01.112348 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:58:01.122853 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:01.123335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:01.123955 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:01.124870 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:01.125625 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:01.126193 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:01.144422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Getting quotas for project 47ea1b6ed7d647b8987e6c128248cab6. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:58:01.149189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Getting quotas for user 802ed5c51d184f6c925f31ab6020ac93 and project 47ea1b6ed7d647b8987e6c128248cab6. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:58:01.215353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:58:01.217708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf63828b-1456-43eb-9b12-0b7dd5cba15b',volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:58:01.387531 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f7eef940-d26e-4a70-a17f-a03d93e88421 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.925662 Aug 05 19:58:01.389495 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 491/996] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:57:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:58:01.401219 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-93293a81-6021-4d2e-977c-9b39a0d3ef12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:01.401829 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-93293a81-6021-4d2e-977c-9b39a0d3ef12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:01.508867 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-93293a81-6021-4d2e-977c-9b39a0d3ef12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:01.520437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-93293a81-6021-4d2e-977c-9b39a0d3ef12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1089 microversion: 2.1 time: 0.123057 Aug 05 19:58:01.526759 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 506/997] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:01 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1089 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:02.549291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:02.549912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:02.558604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:02.559427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:02.559575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:02.560293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:02.560756 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:02.561187 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:02.712421 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:02.716795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:02.731051 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f2a1dc05-cf30-4082-b51f-1e58f2c90f6c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1187 microversion: 2.1 time: 0.185554 Aug 05 19:58:02.731891 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 492/998] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:02 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1187 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:02.790228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-088e7ac9-64a5-4b5b-9d8a-b60f295ff27c req-e0e53195-e453-488b-a5d7-4a7339892ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eae3e8f-bb1f-4494-9e2a-059754aaee19", "tag": "110c0e28-cb8c-4611-86c6-904d92cb1cae"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:02.803902 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-088e7ac9-64a5-4b5b-9d8a-b60f295ff27c req-e0e53195-e453-488b-a5d7-4a7339892ac7 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:02.805226 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-088e7ac9-64a5-4b5b-9d8a-b60f295ff27c req-e0e53195-e453-488b-a5d7-4a7339892ac7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:02.805842 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-088e7ac9-64a5-4b5b-9d8a-b60f295ff27c req-e0e53195-e453-488b-a5d7-4a7339892ac7 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:02.823920 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-088e7ac9-64a5-4b5b-9d8a-b60f295ff27c req-e0e53195-e453-488b-a5d7-4a7339892ac7 service nova] Creating event network-changed:110c0e28-cb8c-4611-86c6-904d92cb1cae for instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 on hv-cinder-85220 Aug 05 19:58:02.848549 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-088e7ac9-64a5-4b5b-9d8a-b60f295ff27c req-e0e53195-e453-488b-a5d7-4a7339892ac7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063265 Aug 05 19:58:02.850014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 507/999] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:58:03.123919 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:03.124603 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:03.138827 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-adb1f97b-6c4b-47d9-9ed6-ca631a2793aa req-dcd0d2a7-86f2-4413-9f3e-2a62db772142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec295b92-6466-4366-ba60-1e1d50beb9d6", "tag": "34a60c93-aacf-4bba-8c03-257ef4588a08"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:03.141396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:03.143124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:03.143598 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:03.145239 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:03.148022 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:03.149635 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:03.154448 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-adb1f97b-6c4b-47d9-9ed6-ca631a2793aa req-dcd0d2a7-86f2-4413-9f3e-2a62db772142 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:03.154953 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-adb1f97b-6c4b-47d9-9ed6-ca631a2793aa req-dcd0d2a7-86f2-4413-9f3e-2a62db772142 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:03.155383 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-adb1f97b-6c4b-47d9-9ed6-ca631a2793aa req-dcd0d2a7-86f2-4413-9f3e-2a62db772142 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:03.177376 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-adb1f97b-6c4b-47d9-9ed6-ca631a2793aa req-dcd0d2a7-86f2-4413-9f3e-2a62db772142 service nova] Creating event network-changed:34a60c93-aacf-4bba-8c03-257ef4588a08 for instance ec295b92-6466-4366-ba60-1e1d50beb9d6 on hv-cinder-85220 Aug 05 19:58:03.201899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-adb1f97b-6c4b-47d9-9ed6-ca631a2793aa req-dcd0d2a7-86f2-4413-9f3e-2a62db772142 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067282 Aug 05 19:58:03.202514 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 508/1000] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:58:03.388427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lazy-loading 'services' on Instance uuid ec295b92-6466-4366-ba60-1e1d50beb9d6 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:58:03.621964 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f5d5f9de-ca18-41bf-b562-e2e727ddbb0c tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments/351a7af7-d665-41f6-a569-fd212de79da0" status: 202 len: 0 microversion: 2.1 time: 0.499769 Aug 05 19:58:03.623499 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 493/1001] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:58:03 2022] DELETE /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments/351a7af7-d665-41f6-a569-fd212de79da0 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:58:03.635379 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:03.642800 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:03.661498 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:03.662508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:03.663029 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:03.667294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:03.667859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:03.671717 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:03.754464 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6d6e4c34-6fca-45eb-8e44-74d49971a12b tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122751 Aug 05 19:58:03.754738 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:03.755404 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:03.761363 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 509/1002] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:58:03 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:03.777773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:03.778300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:03.784986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:03.797424 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:03.798186 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:03.798701 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:04.014409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:04.025518 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-28e35161-b128-4aa6-b910-b85f600e04d0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1205 microversion: 2.1 time: 0.275945 Aug 05 19:58:04.026298 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 494/1003] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:03 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1205 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:58:04.769752 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:04.774458 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:04.782732 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:04.783341 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:04.783893 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:04.784907 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:04.785457 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:04.786038 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:04.824052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f65963dc-6ca2-44e3-848e-d684787e6356 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059316 Aug 05 19:58:04.824985 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 510/1004] 10.222.0.86 () {58 vars in 1302 bytes} [Fri Aug 5 19:58:04 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 19:58:04.837071 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:04.841023 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:04.849118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:04.850255 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:04.851039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:04.852375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:04.854277 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:04.854934 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:04.970447 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] HTTP exception thrown: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 is not attached to volume 351a7af7-d665-41f6-a569-fd212de79da0 Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Request method failure captured: Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: DELETE /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments/351a7af7-d665-41f6-a569-fd212de79da0 HTTP/1.1 Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XWs6ks9dTwRAwl9hMxaY-bGccA_mMKGE6kH508xlYIzmuYvWkXA3L_jH1enFl3ZrTmXpfs_aPHdQvkAIjW8Lag0TkIc9X9vE_9_t7ejoOOEVsPZFFMFiJU6AfDTzXB1WbyaD4guN_sSS7KhkrJWDfE2IVrctiU0-01e55yaUoM9-OE Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: c492b732353043b3bfe7c77daad9df4c Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-TestMinimumBasicScenario-128072570 Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 19:58:04.973790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c492b732353043b3bfe7c77daad9df4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c492b732353043b3bfe7c77daad9df4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c492b732353043b3bfe7c77daad9df4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c492b732353043b3bfe7c77daad9df4c"}]}] Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-TestMinimumBasicScenario-128072570 Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: c492b732353043b3bfe7c77daad9df4c Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-TestMinimumBasicScenario-128072570 Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-TestMinimumBasicScenario-128072570-project Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 48caa6935f9a45b994460b9cb40a4dcf Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-TestMinimumBasicScenario-128072570-project Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 19:58:04.976765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 is not attached to volume 351a7af7-d665-41f6-a569-fd212de79da0 Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'server_id': 'ec295b92-6466-4366-ba60-1e1d50beb9d6', 'id': '351a7af7-d665-41f6-a569-fd212de79da0'} Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 351a7af7-d665-41f6-a569-fd212de79da0. Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:58:04.977881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 is not attached to volume 351a7af7-d665-41f6-a569-fd212de79da0 Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 is not attached to volume 351a7af7-d665-41f6-a569-fd212de79da0 Aug 05 19:58:04.980327 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 19:58:04.983310 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Returning 404 to user: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 is not attached to volume 351a7af7-d665-41f6-a569-fd212de79da0 {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:58:04.984542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-1bd22e79-77f4-4d19-be45-5367e9c948c2 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments/351a7af7-d665-41f6-a569-fd212de79da0" status: 404 len: 154 microversion: 2.1 time: 0.152814 Aug 05 19:58:04.985599 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 495/1005] 10.222.0.86 () {58 vars in 1416 bytes} [Fri Aug 5 19:58:04 2022] DELETE /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6/os-volume_attachments/351a7af7-d665-41f6-a569-fd212de79da0 => generated 154 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:58:05.050261 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:05.051136 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:05.067681 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:05.071228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:05.071812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:05.075206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:05.077564 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:05.078189 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:05.360674 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:05.376887 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-2a43824a-98db-4a23-8d10-896ffcd2f79c tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.331934 Aug 05 19:58:05.395249 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 511/1006] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:05 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:05.914947 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-44f8d158-a79a-42ad-a264-933e403487bf req-127d9dd1-d1fc-4905-bfb1-a685ffcb7261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57", "tag": "7a16a252-25ee-4fe7-a37e-0af634888aa4"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:05.933578 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-44f8d158-a79a-42ad-a264-933e403487bf req-127d9dd1-d1fc-4905-bfb1-a685ffcb7261 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:05.934280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-44f8d158-a79a-42ad-a264-933e403487bf req-127d9dd1-d1fc-4905-bfb1-a685ffcb7261 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:05.934900 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-44f8d158-a79a-42ad-a264-933e403487bf req-127d9dd1-d1fc-4905-bfb1-a685ffcb7261 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:05.947738 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-44f8d158-a79a-42ad-a264-933e403487bf req-127d9dd1-d1fc-4905-bfb1-a685ffcb7261 service nova] Creating event network-changed:7a16a252-25ee-4fe7-a37e-0af634888aa4 for instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 on hv-cinder-85220 Aug 05 19:58:05.953795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-44f8d158-a79a-42ad-a264-933e403487bf req-127d9dd1-d1fc-4905-bfb1-a685ffcb7261 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049793 Aug 05 19:58:05.954682 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 496/1007] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:06.206651 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:06.208292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:06.216314 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:06.217267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:06.219061 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:06.220032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:06.220500 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:06.221116 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:06.227802 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=100 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:06.254154 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Going to try to terminate instance {{(pid=124553) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:58:06.373519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-75801a07-edda-40bc-9dac-af0931c527dd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 204 len: 0 microversion: 2.1 time: 0.170349 Aug 05 19:58:06.374511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 512/1008] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:58:06 2022] DELETE /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:58:06.390287 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:06.391043 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:06.394343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:06.404579 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:06.411802 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:06.413504 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:06.415451 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:06.416011 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:06.416758 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:06.417233 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:06.417671 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:06.428696 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:06.429139 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:06.429841 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:06.430554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:06.431037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:06.431467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:06.594259 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:06.602452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2c5b4375-778a-4fb6-9857-5903f306c339 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1555 microversion: 2.1 time: 0.218178 Aug 05 19:58:06.603074 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 497/1009] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:06 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:06.614073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:06.623037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3d64a7e7-8926-4926-adf9-6ef40f1e8967 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.216187 Aug 05 19:58:06.623683 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 513/1010] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:06 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:07.629225 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:07.630364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:07.640054 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:07.641242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:07.641968 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:07.643155 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:07.650586 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:07.652103 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:07.654199 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:07.655391 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:07.663697 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:07.664769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:07.665541 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:07.666814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:07.667596 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:07.668366 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:07.841364 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:07.843073 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:07.849147 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-d542c4b8-0663-41eb-8c83-deb2ec5283f0 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1555 microversion: 2.1 time: 0.227089 Aug 05 19:58:07.850301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 498/1011] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:07 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:07.851720 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-47ef9b90-3da5-4b59-9ab9-6e8bd1ece60b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.209514 Aug 05 19:58:07.852277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 514/1012] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:07 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:58:08.872438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:08.877646 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:08.878257 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:08.879301 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:08.883587 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:08.891090 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:08.891562 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:08.892038 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:08.892733 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:08.893190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:08.893614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:08.899237 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:08.899761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:08.900424 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:08.903384 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:08.904194 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:08.904823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:09.098159 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:09.107898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-6053b71a-fd44-4245-945b-4226ae0e21e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.234118 Aug 05 19:58:09.108838 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 515/1013] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:08 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:09.254975 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48caa6935f9a45b994460b9cb40a4dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c492b732353043b3bfe7c77daad9df4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:09.264055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b74889ed-feb6-4aa6-9c24-7b3d0f79cddd tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 200 len: 1555 microversion: 2.1 time: 0.395363 Aug 05 19:58:09.264713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 499/1014] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:08 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 1555 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:09.416481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-5a925c7f-0764-4475-bf76-668282e27304 req-a13c84d3-b35e-44d1-9cc8-954daedf407f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec295b92-6466-4366-ba60-1e1d50beb9d6", "name": "network-vif-deleted", "tag": "34a60c93-aacf-4bba-8c03-257ef4588a08"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:09.426983 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-5a925c7f-0764-4475-bf76-668282e27304 req-a13c84d3-b35e-44d1-9cc8-954daedf407f service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:09.427661 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-5a925c7f-0764-4475-bf76-668282e27304 req-a13c84d3-b35e-44d1-9cc8-954daedf407f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:09.428505 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-5a925c7f-0764-4475-bf76-668282e27304 req-a13c84d3-b35e-44d1-9cc8-954daedf407f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:09.440658 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-5a925c7f-0764-4475-bf76-668282e27304 req-a13c84d3-b35e-44d1-9cc8-954daedf407f service nova] Creating event network-vif-deleted:34a60c93-aacf-4bba-8c03-257ef4588a08 for instance ec295b92-6466-4366-ba60-1e1d50beb9d6 on hv-cinder-85220 Aug 05 19:58:09.446705 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-5a925c7f-0764-4475-bf76-668282e27304 req-a13c84d3-b35e-44d1-9cc8-954daedf407f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034728 Aug 05 19:58:09.447306 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 516/1015] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:10.142048 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:10.143200 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:10.162814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:10.162814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:10.162814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:10.162814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:10.163197 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:10.163197 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:10.287050 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:10.287848 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] [instance: ec295b92-6466-4366-ba60-1e1d50beb9d6] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:10.295308 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:10.295886 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:10.296814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:10.297752 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:10.298277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:10.298807 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:10.299357 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:10.308560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-dd9aded0-4a4b-44a2-8f26-645ddaaea599 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.172633 Aug 05 19:58:10.309144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 500/1016] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:10 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:10.315439 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] HTTP exception thrown: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 could not be found. Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Request method failure captured: Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 HTTP/1.1 Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XWs6ks9dTwRAwl9hMxaY-bGccA_mMKGE6kH508xlYIzmuYvWkXA3L_jH1enFl3ZrTmXpfs_aPHdQvkAIjW8Lag0TkIc9X9vE_9_t7ejoOOEVsPZFFMFiJU6AfDTzXB1WbyaD4guN_sSS7KhkrJWDfE2IVrctiU0-01e55yaUoM9-OE Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: c492b732353043b3bfe7c77daad9df4c Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-TestMinimumBasicScenario-128072570 Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:58:10.317963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c492b732353043b3bfe7c77daad9df4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/c492b732353043b3bfe7c77daad9df4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_c492b732353043b3bfe7c77daad9df4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/c492b732353043b3bfe7c77daad9df4c"}]}] Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-TestMinimumBasicScenario-128072570 Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: c492b732353043b3bfe7c77daad9df4c Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-TestMinimumBasicScenario-128072570 Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-TestMinimumBasicScenario-128072570-project Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 48caa6935f9a45b994460b9cb40a4dcf Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-TestMinimumBasicScenario-128072570-project Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 could not be found. Aug 05 19:58:10.319459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'ec295b92-6466-4366-ba60-1e1d50beb9d6'} Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 could not be found. Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:58:10.320481 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 could not be found. Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 could not be found. Aug 05 19:58:10.321701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:10.323302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Returning 404 to user: Instance ec295b92-6466-4366-ba60-1e1d50beb9d6 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:58:10.323302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b06c9b17-7dca-4231-b15a-76642d7d2153 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6" status: 404 len: 111 microversion: 2.1 time: 0.037233 Aug 05 19:58:10.323302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 517/1017] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:10 2022] GET /compute/v2.1/servers/ec295b92-6466-4366-ba60-1e1d50beb9d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 19:58:10.329828 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-402a1688-32e3-4d69-91eb-bf576401c064 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] Calling method '.version_select at 0x7f18c81e8ca0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:10.355777 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-402a1688-32e3-4d69-91eb-bf576401c064 tempest-TestMinimumBasicScenario-128072570 tempest-TestMinimumBasicScenario-128072570-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1145436541" status: 202 len: 0 microversion: 2.1 time: 0.029788 Aug 05 19:58:10.356840 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 501/1018] 10.222.0.86 () {58 vars in 1272 bytes} [Fri Aug 5 19:58:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1145436541 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 19:58:11.329460 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:11.329981 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:11.337501 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:11.338107 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:11.338545 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:11.339290 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:11.339745 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:11.340165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:11.516669 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:11.627854 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:11.636603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-18fd0f76-8001-4385-b2f2-ec760049859a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.311974 Aug 05 19:58:11.637561 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 518/1019] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:11 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:12.659080 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:12.659721 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:12.661669 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:12.662850 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=6 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:12.677024 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:12.683050 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:12.683593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:12.686814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:12.687555 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:12.688206 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:12.981234 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:12.990324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-97c151d7-2a38-42d3-9533-3233ebfd7cf6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.335273 Aug 05 19:58:12.991291 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 502/1020] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:12 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:14.015584 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:14.017410 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:14.049848 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:14.050356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:14.050857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:14.051591 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:14.057260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:14.057786 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:14.409912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:14.420058 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3002798b-63a2-4c7e-a7c8-8c451b469dd4 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.412418 Aug 05 19:58:14.427932 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 519/1021] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:14 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:15.453306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:15.454006 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:15.461352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:15.461907 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:15.462355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:15.464163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:15.464879 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:15.465479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:15.675652 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:15.685185 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f517bf3c-5131-40bf-8d94-065cd93901b2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.235869 Aug 05 19:58:15.685887 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 503/1022] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:15 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:16.705766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:16.706573 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:16.713486 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:16.714649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:16.715160 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:16.715881 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:16.716336 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:16.716917 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:16.873649 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:16.881356 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-01272e27-46d8-43bb-9a4f-a53c421e2235 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.179541 Aug 05 19:58:16.882252 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 520/1023] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:16 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:17.904994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:17.905441 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:17.929044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:17.930217 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:17.938242 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:17.939202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:17.939703 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:17.940258 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:18.150466 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:18.159456 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-cf16996d-8002-4011-995b-b0ceea7925e0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.260657 Aug 05 19:58:18.160352 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 504/1024] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:17 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:19.046585 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-e36bceaa-d295-4dad-bad5-c10d6e426906 req-25550813-259f-4f56-94bb-80b600019bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57", "name": "network-vif-plugged", "status": "completed", "tag": "7a16a252-25ee-4fe7-a37e-0af634888aa4"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:19.061537 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-e36bceaa-d295-4dad-bad5-c10d6e426906 req-25550813-259f-4f56-94bb-80b600019bc3 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:19.062161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-e36bceaa-d295-4dad-bad5-c10d6e426906 req-25550813-259f-4f56-94bb-80b600019bc3 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:19.062689 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-e36bceaa-d295-4dad-bad5-c10d6e426906 req-25550813-259f-4f56-94bb-80b600019bc3 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:19.081248 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-e36bceaa-d295-4dad-bad5-c10d6e426906 req-25550813-259f-4f56-94bb-80b600019bc3 service nova] Creating event network-vif-plugged:7a16a252-25ee-4fe7-a37e-0af634888aa4 for instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 on hv-cinder-85220 Aug 05 19:58:19.098591 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-e36bceaa-d295-4dad-bad5-c10d6e426906 req-25550813-259f-4f56-94bb-80b600019bc3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057112 Aug 05 19:58:19.100263 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 521/1025] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:19.182661 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:19.183617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:19.192567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:19.193397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:19.194114 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:19.196514 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:19.198180 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:19.198980 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:19.425677 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:19.441571 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-543b0c47-cf62-4298-9deb-02204cb8de42 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.264391 Aug 05 19:58:19.444250 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 505/1026] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:19 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:20.469113 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:20.470399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:20.481166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:20.482147 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:20.482529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:20.483631 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:20.484340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:20.485215 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:20.645626 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:20.653685 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-74e0d6fe-ee61-459d-8f59-f1a1a66abf66 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1261 microversion: 2.1 time: 0.194491 Aug 05 19:58:20.654233 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 522/1027] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:20 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:21.675459 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:21.676154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:21.683618 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:21.684190 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:21.684633 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:21.685461 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:21.685930 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:21.686366 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:21.839335 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:21.848497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-46da62e3-1894-493e-8112-500a96009dc6 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1444 microversion: 2.1 time: 0.177105 Aug 05 19:58:21.849063 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 506/1028] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:21 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:21.869191 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:21.869940 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:21.876516 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:21.877001 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:21.877442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:21.878140 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:21.878597 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:21.879044 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:22.015980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:22.023894 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3cd65c6a-06f7-40d3-aab7-b747b12863a1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1444 microversion: 2.1 time: 0.158935 Aug 05 19:58:22.024790 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 523/1029] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:21 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:24.192711 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-f6f98089-3343-4756-8cd3-90558325afdb req-6af88d17-a28a-4c5d-a127-10ca0bdfc5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57", "tag": "7a16a252-25ee-4fe7-a37e-0af634888aa4"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:24.204081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f6f98089-3343-4756-8cd3-90558325afdb req-6af88d17-a28a-4c5d-a127-10ca0bdfc5f6 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:24.204567 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f6f98089-3343-4756-8cd3-90558325afdb req-6af88d17-a28a-4c5d-a127-10ca0bdfc5f6 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:24.205002 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-f6f98089-3343-4756-8cd3-90558325afdb req-6af88d17-a28a-4c5d-a127-10ca0bdfc5f6 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:24.218346 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-f6f98089-3343-4756-8cd3-90558325afdb req-6af88d17-a28a-4c5d-a127-10ca0bdfc5f6 service nova] Creating event network-changed:7a16a252-25ee-4fe7-a37e-0af634888aa4 for instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 on hv-cinder-85220 Aug 05 19:58:24.224181 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-f6f98089-3343-4756-8cd3-90558325afdb req-6af88d17-a28a-4c5d-a127-10ca0bdfc5f6 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035183 Aug 05 19:58:24.224861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 507/1030] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:26.135365 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 19:58:26.135938 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Fri Aug 5 19:58:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 19:58:28.347817 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-252157339", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "networks": [{"uuid": "fd3fc2bc-77d5-4d3d-ba78-ddbe1157f340"}]}} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:28.409137 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.network.neutron [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] validate_networks() for [('fd3fc2bc-77d5-4d3d-ba78-ddbe1157f340', None, None, None, None, None)] {{(pid=124553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:58:28.782971 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Flavor limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:58:28.783422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Image limits 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:58:28.783898 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Flavor pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:58:28.784303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Image pref 0:0:0 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:58:28.784713 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.virt.hardware [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:58:28.793610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:28.794093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:28.794532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:28.795283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:28.795741 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:28.796195 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:28.814045 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Getting quotas for project 1a0f6dc247f547a79f8908d072bc49e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:58:28.818404 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.quota [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Getting quotas for user 2df1b8bc5012478b9ac5b4c2341a8d12 and project 1a0f6dc247f547a79f8908d072bc49e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:58:28.830431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Going to run 1 instances... {{(pid=124553) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:58:28.832726 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:58:28.878426 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0aad9ec9-19c7-4ac5-8925-50b40c54a56b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534486 Aug 05 19:58:28.879099 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 524/1031] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:58:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 19:58:28.891809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2c638efa-6e1b-455d-9982-3e44e32cf2a6 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:28.892561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2c638efa-6e1b-455d-9982-3e44e32cf2a6 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:28.949509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2c638efa-6e1b-455d-9982-3e44e32cf2a6 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:28.956751 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2c638efa-6e1b-455d-9982-3e44e32cf2a6 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1213 microversion: 2.1 time: 0.069555 Aug 05 19:58:28.957344 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 508/1032] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:28 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:29.980351 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:29.981562 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:29.988176 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:29.988909 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:29.989533 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:29.990408 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:29.991081 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:29.991665 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:30.064747 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:30.073435 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-293c5673-2e20-4d33-a2d6-443324b4155a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1271 microversion: 2.1 time: 0.098656 Aug 05 19:58:30.073970 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 525/1033] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:29 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:31.097818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:31.098459 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:31.110189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:31.110812 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:31.111257 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:31.112000 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:31.112463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:31.112892 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:31.260171 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-b844989e-454b-4ddc-a614-b1aa0abed4f2 req-40afc6ad-5095-4c3b-9990-aa65bb43ba9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6a979e4-1406-4a3a-bcc7-1d260856605b", "tag": "f09b02af-2575-40e4-bf03-2867b8946095"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:31.278063 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b844989e-454b-4ddc-a614-b1aa0abed4f2 req-40afc6ad-5095-4c3b-9990-aa65bb43ba9f service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:31.278875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b844989e-454b-4ddc-a614-b1aa0abed4f2 req-40afc6ad-5095-4c3b-9990-aa65bb43ba9f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:31.279560 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-b844989e-454b-4ddc-a614-b1aa0abed4f2 req-40afc6ad-5095-4c3b-9990-aa65bb43ba9f service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:31.294422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-b844989e-454b-4ddc-a614-b1aa0abed4f2 req-40afc6ad-5095-4c3b-9990-aa65bb43ba9f service nova] Creating event network-changed:f09b02af-2575-40e4-bf03-2867b8946095 for instance d6a979e4-1406-4a3a-bcc7-1d260856605b on hv-cinder-85220 Aug 05 19:58:31.300577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-b844989e-454b-4ddc-a614-b1aa0abed4f2 req-40afc6ad-5095-4c3b-9990-aa65bb43ba9f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044414 Aug 05 19:58:31.301970 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 526/1034] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:31.396636 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:31.407053 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-9877cc25-a4e3-491c-96f7-4997cc194e04 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1313 microversion: 2.1 time: 0.313614 Aug 05 19:58:31.408097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 509/1035] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:31 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:32.428997 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:32.430372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:32.436900 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:32.437385 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:32.437818 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:32.438510 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:32.438989 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:32.439411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:32.584354 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:32.592523 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-ea0e9144-53da-4bd6-987d-afd508bfed54 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1313 microversion: 2.1 time: 0.168004 Aug 05 19:58:32.593603 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 527/1036] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:32 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:33.613341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:33.613974 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:33.620776 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:33.621306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:33.621890 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:33.622616 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:33.623123 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:33.623556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:33.626306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:33.763925 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:33.771279 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7c0ab31b-6c3a-40fe-82a6-3bde7256c533 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1313 microversion: 2.1 time: 0.161818 Aug 05 19:58:33.771841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 510/1037] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:33 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:34.793593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:34.794258 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:34.800775 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:34.801265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:34.801704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:34.802416 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:34.802900 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:34.803332 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:34.942201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:34.950207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-15563980-9e7c-42f2-af26-86e3d7fed87d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1313 microversion: 2.1 time: 0.160683 Aug 05 19:58:34.950875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 528/1038] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:34 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:35.971390 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:35.972799 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:35.980851 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:35.981353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:35.981943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:35.982987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:35.983490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:35.984016 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:36.142436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:36.150326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a2e16d6b-07dc-4421-9a1f-fd74e8874f51 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1313 microversion: 2.1 time: 0.182824 Aug 05 19:58:36.151023 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 511/1039] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:35 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:36.912984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-f69241c8-b532-4db7-b11d-34f75cd7f3f3 req-0765bb38-8c58-4663-bcda-acdf82ba44a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6a979e4-1406-4a3a-bcc7-1d260856605b", "name": "network-vif-plugged", "status": "completed", "tag": "f09b02af-2575-40e4-bf03-2867b8946095"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:36.924355 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-f69241c8-b532-4db7-b11d-34f75cd7f3f3 req-0765bb38-8c58-4663-bcda-acdf82ba44a5 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:36.924775 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-f69241c8-b532-4db7-b11d-34f75cd7f3f3 req-0765bb38-8c58-4663-bcda-acdf82ba44a5 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:36.925678 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-f69241c8-b532-4db7-b11d-34f75cd7f3f3 req-0765bb38-8c58-4663-bcda-acdf82ba44a5 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:36.931168 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:36.939744 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-f69241c8-b532-4db7-b11d-34f75cd7f3f3 req-0765bb38-8c58-4663-bcda-acdf82ba44a5 service nova] Creating event network-vif-plugged:f09b02af-2575-40e4-bf03-2867b8946095 for instance d6a979e4-1406-4a3a-bcc7-1d260856605b on hv-cinder-85220 Aug 05 19:58:36.944871 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-f69241c8-b532-4db7-b11d-34f75cd7f3f3 req-0765bb38-8c58-4663-bcda-acdf82ba44a5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036419 Aug 05 19:58:36.945775 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 529/1040] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:58:37.172541 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:37.173788 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:37.176270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:37.183846 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:37.184338 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:37.184976 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:37.185683 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:37.186130 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:37.186751 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:37.322949 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:37.330343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-64e83fb5-bf28-4412-8f07-438eb090104a tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1313 microversion: 2.1 time: 0.161923 Aug 05 19:58:37.331583 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 512/1041] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:37 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:38.353326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:38.354035 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:38.361948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:38.362434 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:38.362909 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:38.363609 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:38.364065 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:38.364488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:38.510497 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:38.518102 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-dee14c3c-b24f-405a-9e27-e589e1f14efb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1496 microversion: 2.1 time: 0.170686 Aug 05 19:58:38.518922 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 530/1042] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:38 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:38.988774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:38.989298 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:38.992594 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:38.999281 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:38.999795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:39.000248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:39.000958 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:39.001422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:39.001858 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:39.034073 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:58:39.125976 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0fa95a75-f802-41a0-990f-cb1bbd507adb tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 204 len: 0 microversion: 2.1 time: 0.141931 Aug 05 19:58:39.126574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 513/1043] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:58:38 2022] DELETE /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:58:39.136636 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:39.137283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:39.139582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:39.140261 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=6 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:39.144812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:39.152232 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:39.152732 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:39.153173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:39.153879 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:39.154322 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:39.154776 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:39.358796 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:39.366786 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3b62a7ec-0663-4198-94de-a4e987c253e7 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1502 microversion: 2.1 time: 0.235520 Aug 05 19:58:39.367577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 531/1044] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:39 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:40.389539 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:40.390265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:40.397538 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:40.398041 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:40.398534 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:40.399781 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:40.400235 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:40.400667 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:40.554405 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:40.565115 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b20ffa68-882e-40ef-96c7-a314d56b5d82 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1502 microversion: 2.1 time: 0.179965 Aug 05 19:58:40.565702 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 514/1045] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:40 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:41.458036 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-4f64e46f-9921-4764-ae16-654ba7fdbea4 req-745b5b43-4ff9-4dfd-b888-82b0ea6312b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6a979e4-1406-4a3a-bcc7-1d260856605b", "name": "network-vif-deleted", "tag": "f09b02af-2575-40e4-bf03-2867b8946095"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:41.468918 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-4f64e46f-9921-4764-ae16-654ba7fdbea4 req-745b5b43-4ff9-4dfd-b888-82b0ea6312b5 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:41.469411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-4f64e46f-9921-4764-ae16-654ba7fdbea4 req-745b5b43-4ff9-4dfd-b888-82b0ea6312b5 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:41.470179 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-4f64e46f-9921-4764-ae16-654ba7fdbea4 req-745b5b43-4ff9-4dfd-b888-82b0ea6312b5 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:41.489117 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-4f64e46f-9921-4764-ae16-654ba7fdbea4 req-745b5b43-4ff9-4dfd-b888-82b0ea6312b5 service nova] Creating event network-vif-deleted:f09b02af-2575-40e4-bf03-2867b8946095 for instance d6a979e4-1406-4a3a-bcc7-1d260856605b on hv-cinder-85220 Aug 05 19:58:41.495039 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-4f64e46f-9921-4764-ae16-654ba7fdbea4 req-745b5b43-4ff9-4dfd-b888-82b0ea6312b5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040467 Aug 05 19:58:41.495884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 532/1046] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:41.588477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:41.589085 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:41.595378 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:41.595859 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:41.596293 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:41.596981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:41.597431 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:41.597854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:41.633593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:41.634088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:41.634536 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:41.635012 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lazy-loading 'fault' on Instance uuid d6a979e4-1406-4a3a-bcc7-1d260856605b {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:58:41.677315 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:41.686163 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e8ba3fc6-8b59-4f68-93b6-ba49e571f073 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 200 len: 1303 microversion: 2.1 time: 0.102166 Aug 05 19:58:41.686756 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 515/1047] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:41 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:42.707601 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:42.708326 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: d6a979e4-1406-4a3a-bcc7-1d260856605b] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:42.714538 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:42.715438 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:42.715569 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:42.716167 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:42.716620 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:42.717046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:42.730457 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] HTTP exception thrown: Instance d6a979e4-1406-4a3a-bcc7-1d260856605b could not be found. Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Request method failure captured: Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b HTTP/1.1 Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XZiyGSdsqq0LE8zPiS40C8G40ddsoL8TzzBMMoOz7lbttkoMzeXMhtey7OiQja1Z5FefCx_ZolaAhJCoa7y64H1wf_JMPdSSIYN_EX1cPqST23Tz7M_lPvt_bbI3Q4HQmeTbE4ACW8_ypWHfc_yoHdqDKMy9e10FWiO6Q04Aekgq0E Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 1a0f6dc247f547a79f8908d072bc49e3 Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesActionsTest-113694528 Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:58:42.732126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/1a0f6dc247f547a79f8908d072bc49e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/1a0f6dc247f547a79f8908d072bc49e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_1a0f6dc247f547a79f8908d072bc49e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/1a0f6dc247f547a79f8908d072bc49e3"}]}] Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesActionsTest-113694528 Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 1a0f6dc247f547a79f8908d072bc49e3 Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesActionsTest-113694528 Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesActionsTest-113694528-project Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 2df1b8bc5012478b9ac5b4c2341a8d12 Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesActionsTest-113694528-project Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance d6a979e4-1406-4a3a-bcc7-1d260856605b could not be found. Aug 05 19:58:42.733823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': 'd6a979e4-1406-4a3a-bcc7-1d260856605b'} Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6a979e4-1406-4a3a-bcc7-1d260856605b could not be found. Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:58:42.734815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6a979e4-1406-4a3a-bcc7-1d260856605b could not be found. Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6a979e4-1406-4a3a-bcc7-1d260856605b could not be found. Aug 05 19:58:42.736382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:42.737797 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Returning 404 to user: Instance d6a979e4-1406-4a3a-bcc7-1d260856605b could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:58:42.737797 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-9fabcc09-ac9d-4d4e-b238-bad1de0f52ba tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b" status: 404 len: 111 microversion: 2.1 time: 0.030747 Aug 05 19:58:42.737797 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 533/1048] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:42 2022] GET /compute/v2.1/servers/d6a979e4-1406-4a3a-bcc7-1d260856605b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:58:42.832844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-322517148", "imageRef": "25039a18-0ac0-43d9-b8d5-1aeb4ece44ab", "flavorRef": "452", "networks": [{"uuid": "fd3fc2bc-77d5-4d3d-ba78-ddbe1157f340"}]}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:42.886848 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] validate_networks() for [('fd3fc2bc-77d5-4d3d-ba78-ddbe1157f340', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 19:58:43.248313 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 19:58:43.248739 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 19:58:43.249272 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 19:58:43.249627 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 19:58:43.250045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 19:58:43.260105 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:43.260676 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:43.261213 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:43.262013 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:43.262542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:43.263196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:43.280858 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Getting quotas for project 1a0f6dc247f547a79f8908d072bc49e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 19:58:43.285255 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Getting quotas for user 2df1b8bc5012478b9ac5b4c2341a8d12 and project 1a0f6dc247f547a79f8908d072bc49e3. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 19:58:43.299450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 19:58:43.301713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25039a18-0ac0-43d9-b8d5-1aeb4ece44ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 19:58:43.352039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b3450d4a-4e45-4e67-b083-18962c8b6a9d tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523051 Aug 05 19:58:43.352757 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 516/1049] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 19:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 19:58:43.363648 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-56b129e0-e168-4654-ae18-d2bf783c3fd0 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:43.364265 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-56b129e0-e168-4654-ae18-d2bf783c3fd0 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:43.424399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-56b129e0-e168-4654-ae18-d2bf783c3fd0 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:43.435554 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-56b129e0-e168-4654-ae18-d2bf783c3fd0 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1213 microversion: 2.1 time: 0.075461 Aug 05 19:58:43.436631 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 534/1050] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:43 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:44.458664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:44.460005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:44.468319 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:44.468913 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:44.469432 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:44.470249 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:44.471007 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:44.471722 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:44.553220 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:44.562992 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c5f53008-c7f9-4458-81a8-9a2098a823bf tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1271 microversion: 2.1 time: 0.109298 Aug 05 19:58:44.563664 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 517/1051] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:44 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:45.586407 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:45.587301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:45.594238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:45.594766 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:45.595211 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:45.595915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:45.596379 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:45.596809 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:45.672397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-68b3d45e-94c9-4e9c-a155-7c0ff0bb82c6 req-7bb79836-605e-44ab-948d-57bcc629d882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c2efd0-cabe-4363-a19f-27ece33586b4", "tag": "8562dbe1-8113-41de-a50b-9ba170dc4168"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:45.698362 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-68b3d45e-94c9-4e9c-a155-7c0ff0bb82c6 req-7bb79836-605e-44ab-948d-57bcc629d882 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:45.698897 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-68b3d45e-94c9-4e9c-a155-7c0ff0bb82c6 req-7bb79836-605e-44ab-948d-57bcc629d882 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:45.699574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-68b3d45e-94c9-4e9c-a155-7c0ff0bb82c6 req-7bb79836-605e-44ab-948d-57bcc629d882 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:45.712241 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-68b3d45e-94c9-4e9c-a155-7c0ff0bb82c6 req-7bb79836-605e-44ab-948d-57bcc629d882 service nova] Creating event network-changed:8562dbe1-8113-41de-a50b-9ba170dc4168 for instance 24c2efd0-cabe-4363-a19f-27ece33586b4 on hv-cinder-85220 Aug 05 19:58:45.717355 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-68b3d45e-94c9-4e9c-a155-7c0ff0bb82c6 req-7bb79836-605e-44ab-948d-57bcc629d882 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049702 Aug 05 19:58:45.717962 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 518/1052] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:45.743875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:45.752387 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-17001f2e-770f-4cc6-b159-5f54bac35d46 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1313 microversion: 2.1 time: 0.169881 Aug 05 19:58:45.765258 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 535/1053] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:45 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:46.773847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:46.774542 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:46.781336 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:46.781824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:46.782270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:46.783019 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:46.783469 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:46.783900 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:46.922956 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:46.931244 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-64fa22da-6518-49f2-9d3b-811bf2e131be tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1313 microversion: 2.1 time: 0.161690 Aug 05 19:58:46.932093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 519/1054] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:46 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:47.952782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:47.953391 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:47.959810 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:47.960292 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:47.960723 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:47.962378 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:47.963053 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:47.963479 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:48.100302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:48.107958 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0001d47a-c20f-492a-884d-df657c5560ef tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1313 microversion: 2.1 time: 0.159056 Aug 05 19:58:48.108532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 536/1055] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:47 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:49.129256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:49.129879 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:49.136823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:49.137347 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:49.137792 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:49.138490 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:49.138981 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:49.139418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:49.272486 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:49.285842 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4c758e73-77bc-41f2-a937-e8a45c87d228 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1313 microversion: 2.1 time: 0.160023 Aug 05 19:58:49.286816 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 520/1056] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:49 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:50.308440 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:50.309155 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:50.315870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:50.316358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:50.316793 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:50.317492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:50.317947 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:50.318373 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:50.470362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:50.478376 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c0ae445a-c031-4e26-a3ce-3be64eed3810 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1313 microversion: 2.1 time: 0.174890 Aug 05 19:58:50.478944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 537/1057] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:50 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:51.027193 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-0387ef63-f820-4f78-a6ca-a746e1ff8293 req-464dc4f8-5cbe-44d5-8b64-d07b6999ea55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c2efd0-cabe-4363-a19f-27ece33586b4", "name": "network-vif-plugged", "status": "completed", "tag": "8562dbe1-8113-41de-a50b-9ba170dc4168"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:51.039398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0387ef63-f820-4f78-a6ca-a746e1ff8293 req-464dc4f8-5cbe-44d5-8b64-d07b6999ea55 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:51.041029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0387ef63-f820-4f78-a6ca-a746e1ff8293 req-464dc4f8-5cbe-44d5-8b64-d07b6999ea55 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:51.041943 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-0387ef63-f820-4f78-a6ca-a746e1ff8293 req-464dc4f8-5cbe-44d5-8b64-d07b6999ea55 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:51.054845 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-0387ef63-f820-4f78-a6ca-a746e1ff8293 req-464dc4f8-5cbe-44d5-8b64-d07b6999ea55 service nova] Creating event network-vif-plugged:8562dbe1-8113-41de-a50b-9ba170dc4168 for instance 24c2efd0-cabe-4363-a19f-27ece33586b4 on hv-cinder-85220 Aug 05 19:58:51.060835 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-0387ef63-f820-4f78-a6ca-a746e1ff8293 req-464dc4f8-5cbe-44d5-8b64-d07b6999ea55 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040591 Aug 05 19:58:51.062152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 521/1058] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:51.502003 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:51.502915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:51.512264 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:51.513052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:51.513781 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:51.514921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:51.516147 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:51.516653 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:51.723607 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:51.733646 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7f5ce993-84f1-4f9a-902a-40589c735f72 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1313 microversion: 2.1 time: 0.236947 Aug 05 19:58:51.734247 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 538/1059] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:51 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:52.756332 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:52.757148 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:52.765161 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:52.765984 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:52.766455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:52.767200 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:52.767665 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:52.768098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:52.933990 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:52.942247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4664d342-8b77-4d85-87ac-e2d259832e09 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1313 microversion: 2.1 time: 0.190648 Aug 05 19:58:52.943318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 522/1060] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:52 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:53.964455 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:53.966238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:53.972230 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:53.974695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:53.975188 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:53.975627 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:53.976335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:53.976788 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:53.977202 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:54.121893 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:54.129303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a3d0c905-5603-41c5-894e-413dc250a8b8 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1497 microversion: 2.1 time: 0.169429 Aug 05 19:58:54.129859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 539/1061] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:53 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:54.623184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:54.623704 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:54.625629 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:54.626296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=6 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:54.633010 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:54.633498 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:54.634479 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:54.635339 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:54.635804 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:54.636235 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:54.663537 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 19:58:54.742647 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b4e01b61-aabd-407f-a6bc-130b1ff20f62 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "DELETE /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 204 len: 0 microversion: 2.1 time: 0.123049 Aug 05 19:58:54.743251 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 523/1062] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:58:54 2022] DELETE /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 19:58:54.758677 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:54.760449 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:54.766466 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:54.767002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:54.767422 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:54.768111 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:54.768563 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:54.768982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:54.906992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:54.914464 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-daa617fb-d106-4da2-81c3-45140ec85cd5 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1503 microversion: 2.1 time: 0.165391 Aug 05 19:58:54.915060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 540/1063] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:54 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:58:55.937195 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:55.937904 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:55.944521 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:55.945007 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:55.945543 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:55.946240 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:55.947237 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:55.947666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:56.077912 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:56.085561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b0204dbc-a2a8-4b6a-8480-f47d73738434 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1503 microversion: 2.1 time: 0.152569 Aug 05 19:58:56.086131 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 524/1064] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:55 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:58:56.724991 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-0f611972-22dc-4f57-b5da-c25b47c153a8 req-341fc459-2cb3-4226-9165-7ba683e5d4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c2efd0-cabe-4363-a19f-27ece33586b4", "name": "network-vif-deleted", "tag": "8562dbe1-8113-41de-a50b-9ba170dc4168"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:56.737789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-0f611972-22dc-4f57-b5da-c25b47c153a8 req-341fc459-2cb3-4226-9165-7ba683e5d4d5 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:56.738575 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-0f611972-22dc-4f57-b5da-c25b47c153a8 req-341fc459-2cb3-4226-9165-7ba683e5d4d5 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:56.739042 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-0f611972-22dc-4f57-b5da-c25b47c153a8 req-341fc459-2cb3-4226-9165-7ba683e5d4d5 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:56.751700 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-0f611972-22dc-4f57-b5da-c25b47c153a8 req-341fc459-2cb3-4226-9165-7ba683e5d4d5 service nova] Creating event network-vif-deleted:8562dbe1-8113-41de-a50b-9ba170dc4168 for instance 24c2efd0-cabe-4363-a19f-27ece33586b4 on hv-cinder-85220 Aug 05 19:58:56.756813 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-0f611972-22dc-4f57-b5da-c25b47c153a8 req-341fc459-2cb3-4226-9165-7ba683e5d4d5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035823 Aug 05 19:58:56.757411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 541/1065] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 19:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:57.108504 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:57.109122 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:57.115668 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:57.116149 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:57.116666 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:57.117353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:57.117808 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:57.118253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:57.135785 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:57.156285 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:57.156773 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:57.157207 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:57.157657 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lazy-loading 'fault' on Instance uuid 24c2efd0-cabe-4363-a19f-27ece33586b4 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 19:58:57.213658 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df1b8bc5012478b9ac5b4c2341a8d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f6dc247f547a79f8908d072bc49e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 19:58:57.222097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-88b01391-eafe-44df-9310-0cf209d28d90 tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 200 len: 1303 microversion: 2.1 time: 0.117390 Aug 05 19:58:57.222698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 525/1066] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:57 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:58.245002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:58.245699 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] [instance: 24c2efd0-cabe-4363-a19f-27ece33586b4] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:58:58.252058 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:58.252566 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:58.253006 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:58.253717 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:58:58.254174 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:58:58.254597 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:58:58.268062 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] HTTP exception thrown: Instance 24c2efd0-cabe-4363-a19f-27ece33586b4 could not be found. Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Request method failure captured: Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 HTTP/1.1 Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XZiyGSdsqq0LE8zPiS40C8G40ddsoL8TzzBMMoOz7lbttkoMzeXMhtey7OiQja1Z5FefCx_ZolaAhJCoa7y64H1wf_JMPdSSIYN_EX1cPqST23Tz7M_lPvt_bbI3Q4HQmeTbE4ACW8_ypWHfc_yoHdqDKMy9e10FWiO6Q04Aekgq0E Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 1a0f6dc247f547a79f8908d072bc49e3 Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-VolumesActionsTest-113694528 Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 19:58:58.269769 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/1a0f6dc247f547a79f8908d072bc49e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/1a0f6dc247f547a79f8908d072bc49e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_1a0f6dc247f547a79f8908d072bc49e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/1a0f6dc247f547a79f8908d072bc49e3"}]}] Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-VolumesActionsTest-113694528 Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 1a0f6dc247f547a79f8908d072bc49e3 Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-VolumesActionsTest-113694528 Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-VolumesActionsTest-113694528-project Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 2df1b8bc5012478b9ac5b4c2341a8d12 Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-VolumesActionsTest-113694528-project Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 24c2efd0-cabe-4363-a19f-27ece33586b4 could not be found. Aug 05 19:58:58.271529 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '24c2efd0-cabe-4363-a19f-27ece33586b4'} Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c2efd0-cabe-4363-a19f-27ece33586b4 could not be found. Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:58:58.272675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c2efd0-cabe-4363-a19f-27ece33586b4 could not be found. Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c2efd0-cabe-4363-a19f-27ece33586b4 could not be found. Aug 05 19:58:58.274297 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 19:58:58.276098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] Returning 404 to user: Instance 24c2efd0-cabe-4363-a19f-27ece33586b4 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:58:58.276098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8fc8733a-4345-4c8d-bc48-25933ae2990b tempest-VolumesActionsTest-113694528 tempest-VolumesActionsTest-113694528-project] 10.222.0.86 "GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4" status: 404 len: 111 microversion: 2.1 time: 0.031834 Aug 05 19:58:58.276098 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 542/1067] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 19:58:58 2022] GET /compute/v2.1/servers/24c2efd0-cabe-4363-a19f-27ece33586b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 19:59:59.949676 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:59.950418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=7 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:59.954556 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:59:59.955086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 19:59:59.962094 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:59:59.962574 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:59:59.963035 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:59:59.963724 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:59:59.964178 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:59:59.965152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:59:59.990740 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:00:00.066271 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-18ac5fe7-3a01-46e0-ab64-98772dec6108 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "DELETE /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 204 len: 0 microversion: 2.1 time: 0.118373 Aug 05 20:00:00.066897 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 526/1068] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 19:59:59 2022] DELETE /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:00:00.073407 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=25 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:00.074841 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=57 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:00.080277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:00.081180 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:00.087927 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:00.088547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:00.089048 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:00.090309 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:00.090801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:00.091231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:00.384984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:00.392643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-02ad1599-7129-4085-bddd-e6d2822aef46 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1577 microversion: 2.1 time: 0.321544 Aug 05 20:00:00.393217 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 543/1069] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:00 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1577 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:01.413938 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:01.414647 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:01.421884 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:01.422369 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:01.422865 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:01.423604 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:01.424058 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:01.424483 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:01.618906 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:01.627797 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-86ae8d0a-fb71-4818-a2db-dfb3d80619ab tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1577 microversion: 2.1 time: 0.218177 Aug 05 20:00:01.628361 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 527/1070] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:01 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:02.649647 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:02.650277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:02.657222 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:02.657710 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:02.658144 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:02.658869 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:02.659327 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:02.659750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:02.813411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:02.821877 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-46018d92-a148-412f-b4fb-82fe78152f37 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 200 len: 1577 microversion: 2.1 time: 0.176297 Aug 05 20:00:02.822719 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 544/1071] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:02 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:03.061560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-32f22f74-06d1-4c0a-9e17-208da15b5527 req-669d709c-c8fc-451f-9275-b048b7c07d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eae3e8f-bb1f-4494-9e2a-059754aaee19", "name": "network-vif-deleted", "tag": "110c0e28-cb8c-4611-86c6-904d92cb1cae"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:03.072745 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-32f22f74-06d1-4c0a-9e17-208da15b5527 req-669d709c-c8fc-451f-9275-b048b7c07d99 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:03.073233 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-32f22f74-06d1-4c0a-9e17-208da15b5527 req-669d709c-c8fc-451f-9275-b048b7c07d99 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:03.073672 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-32f22f74-06d1-4c0a-9e17-208da15b5527 req-669d709c-c8fc-451f-9275-b048b7c07d99 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:03.086954 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-32f22f74-06d1-4c0a-9e17-208da15b5527 req-669d709c-c8fc-451f-9275-b048b7c07d99 service nova] Creating event network-vif-deleted:110c0e28-cb8c-4611-86c6-904d92cb1cae for instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 on hv-cinder-85220 Aug 05 20:00:03.092854 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-32f22f74-06d1-4c0a-9e17-208da15b5527 req-669d709c-c8fc-451f-9275-b048b7c07d99 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035591 Aug 05 20:00:03.093686 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 528/1072] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:03.846384 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:03.849851 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:03.857982 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:03.858897 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:03.859021 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:03.859686 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:03.860145 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:03.860576 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:03.876231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] HTTP exception thrown: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Request method failure captured: Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 HTTP/1.1 Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XYaaad4PEScnBhMnpRdD1sb2uzjE8Gfvir0PQew2beWkonFs_mP-Ol0aMDuLgI2CKLunQlDbNPAFO7eEVFN-AkZDtaqZZDqm6dwQIKQpM4C08dEnhHmm6MXRSdDUHDdQK-ZyX-dVCbsilh2Clr98e0Zfdg-edaozqFChou-d_ue8tk Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 20:00:03.877801 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}] Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 19c2f15eb1644278b911cc50370da9b7 Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:00:03.879708 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '5eae3e8f-bb1f-4494-9e2a-059754aaee19'} Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:00:03.880580 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:00:03.881915 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:00:03.883283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Returning 404 to user: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:00:03.883283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-96794e33-4601-4550-b20c-d9891ad1f8b7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 404 len: 111 microversion: 2.1 time: 0.039790 Aug 05 20:00:03.883283 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 545/1073] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:03 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:00:03.993004 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-963954482", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1274635914", "security_groups": [{"name": "tempest-secgroup-smoke-493261908"}], "block_device_mapping_v2": [{"uuid": "f9c8ef05-db8d-464b-82be-3f7ec7e1a90a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "502545db-6859-4120-9256-0caba07649d2"}]}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:04.115655 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] validate_networks() for [('502545db-6859-4120-9256-0caba07649d2', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:00:04.516731 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:00:04.517162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:00:04.517662 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:00:04.518078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:00:04.518497 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:00:04.527849 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:04.528519 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:04.528961 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:04.529693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:04.530154 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:04.530584 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:04.547898 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Getting quotas for project 7372aebdf6554202a45b0bbd7bad0700. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:00:04.551895 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Getting quotas for user 19c2f15eb1644278b911cc50370da9b7 and project 7372aebdf6554202a45b0bbd7bad0700. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:00:04.609590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:00:04.611790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9c8ef05-db8d-464b-82be-3f7ec7e1a90a',volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:00:04.743270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5c3434ee-6b2e-45e1-8012-3ad4ab78771e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.754562 Aug 05 20:00:04.743918 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 529/1074] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 20:00:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:00:04.754914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d02bba28-f421-456d-b0f8-38a190a6c5e9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:04.755530 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d02bba28-f421-456d-b0f8-38a190a6c5e9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:04.812707 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d02bba28-f421-456d-b0f8-38a190a6c5e9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:04.819471 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d02bba28-f421-456d-b0f8-38a190a6c5e9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1094 microversion: 2.1 time: 0.068457 Aug 05 20:00:04.820037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 546/1075] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:04 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:05.840771 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:05.840771 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:05.848119 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:05.848614 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:05.849050 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:05.849748 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:05.850206 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:05.850657 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:05.930257 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:05.939061 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b81f716f-2d30-4161-8318-aeca4c73e155 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1210 microversion: 2.1 time: 0.103387 Aug 05 20:00:05.939635 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 530/1076] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:05 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:06.960346 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:06.960967 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:06.969796 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:06.970285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:06.970750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:06.971449 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:06.971912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:06.972334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:07.026769 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-b5eb5bce-55e6-4532-a33a-387b4fa84f87 req-d932f6aa-b386-45f0-8b22-4ca0f7cc1bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d121c63f-0748-4dbc-85f0-09614af1dc82", "tag": "d57daa02-7dd2-467f-a0dc-bca9b23305d8"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:07.041580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b5eb5bce-55e6-4532-a33a-387b4fa84f87 req-d932f6aa-b386-45f0-8b22-4ca0f7cc1bab service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:07.042617 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b5eb5bce-55e6-4532-a33a-387b4fa84f87 req-d932f6aa-b386-45f0-8b22-4ca0f7cc1bab service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:07.044860 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b5eb5bce-55e6-4532-a33a-387b4fa84f87 req-d932f6aa-b386-45f0-8b22-4ca0f7cc1bab service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:07.058273 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-b5eb5bce-55e6-4532-a33a-387b4fa84f87 req-d932f6aa-b386-45f0-8b22-4ca0f7cc1bab service nova] Creating event network-changed:d57daa02-7dd2-467f-a0dc-bca9b23305d8 for instance d121c63f-0748-4dbc-85f0-09614af1dc82 on hv-cinder-85220 Aug 05 20:00:07.065650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-b5eb5bce-55e6-4532-a33a-387b4fa84f87 req-d932f6aa-b386-45f0-8b22-4ca0f7cc1bab service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042163 Aug 05 20:00:07.066450 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 531/1077] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:07.367823 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:07.376536 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0be04f67-7fa9-4ce3-801f-f7c738e4724d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.420076 Aug 05 20:00:07.377106 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 547/1078] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:06 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:08.397900 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:08.398523 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:08.405475 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:08.405966 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:08.406410 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:08.407136 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:08.407600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:08.408033 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:08.550076 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:08.557689 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-4a20e1a7-7c80-4abf-bf8c-8c7c9f2584e0 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.164614 Aug 05 20:00:08.558262 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 532/1079] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:08 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:09.579704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:09.580433 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:09.586650 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:09.587130 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:09.587561 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:09.588238 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:09.588690 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:09.589109 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:09.722746 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:09.730088 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c47b1003-5dc9-49a5-8446-b1ba75757322 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.154288 Aug 05 20:00:09.730921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 548/1080] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:09 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:10.751170 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:10.751744 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:10.758179 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:10.758790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:10.759253 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:10.759945 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:10.760411 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:10.760847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:10.893742 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:10.901341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-80bbd6b7-7bab-411a-8ad9-d24a0c44cc0a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.154135 Aug 05 20:00:10.901904 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 533/1081] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:10 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:11.922153 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:11.922833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:11.929340 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:11.929824 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:11.930267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:11.930997 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:11.931456 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:11.931885 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:12.075419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:12.082912 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3f634673-10be-4a2f-b50d-12c3251192b6 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.164726 Aug 05 20:00:12.083478 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 549/1082] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:11 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:13.103564 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:13.104183 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:13.112189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:13.112693 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:13.113134 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:13.113841 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:13.114305 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:13.114763 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:13.253470 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:13.260968 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c2d4cbcb-f32e-48ff-9391-a4e9dc865b4c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.161469 Aug 05 20:00:13.261534 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 534/1083] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:13 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:14.282370 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:14.283002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:14.289510 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:14.290014 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:14.290441 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:14.291207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:14.291811 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:14.292228 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:14.427722 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:14.435996 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-edd1a332-3ddd-4bba-b25c-c2ba8fb46e68 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.158506 Aug 05 20:00:14.436560 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 550/1084] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:14 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:15.457696 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:15.458344 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:15.460852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:15.461509 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=6 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:15.467708 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:15.468197 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:15.468635 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:15.469334 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:15.469790 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:15.470215 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:15.604059 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:15.612230 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-e2b0323f-f121-4d11-aa41-b39718bcdc73 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.158632 Aug 05 20:00:15.612799 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 535/1085] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:15 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:16.634086 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:16.634728 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:16.637182 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:16.642874 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:16.643367 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:16.643798 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:16.644487 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:16.644936 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:16.645353 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:16.780151 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:16.787703 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7d6a87f4-1ef1-4b3f-a3c2-0f1b2892fc9c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.157685 Aug 05 20:00:16.788267 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 551/1086] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:16 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:17.379020 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-45318996-cbaf-4452-ad30-525f9376a98b req-c16fa732-6c2b-472f-b04d-32f60f306648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d121c63f-0748-4dbc-85f0-09614af1dc82", "name": "network-vif-plugged", "status": "completed", "tag": "d57daa02-7dd2-467f-a0dc-bca9b23305d8"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:17.389058 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-45318996-cbaf-4452-ad30-525f9376a98b req-c16fa732-6c2b-472f-b04d-32f60f306648 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:17.389550 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-45318996-cbaf-4452-ad30-525f9376a98b req-c16fa732-6c2b-472f-b04d-32f60f306648 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:17.389988 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-45318996-cbaf-4452-ad30-525f9376a98b req-c16fa732-6c2b-472f-b04d-32f60f306648 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:17.401245 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-45318996-cbaf-4452-ad30-525f9376a98b req-c16fa732-6c2b-472f-b04d-32f60f306648 service nova] Creating event network-vif-plugged:d57daa02-7dd2-467f-a0dc-bca9b23305d8 for instance d121c63f-0748-4dbc-85f0-09614af1dc82 on hv-cinder-85220 Aug 05 20:00:17.407030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-45318996-cbaf-4452-ad30-525f9376a98b req-c16fa732-6c2b-472f-b04d-32f60f306648 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Aug 05 20:00:17.407623 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 536/1087] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:17.810323 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:17.811047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:17.817394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:17.817868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:17.818300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:17.819021 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:17.819472 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:17.819893 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:17.952142 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:17.959587 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-7cc6922e-a7e3-4853-be77-2fffabfb672b tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.154583 Aug 05 20:00:17.960158 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 552/1088] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:17 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:18.983013 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:18.983713 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:18.989823 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:18.990309 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:18.990776 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:18.991474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:18.991953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:18.992382 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:19.128625 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:19.136140 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7b820634-30b7-4eaa-8e49-0d797e22c38d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1265 microversion: 2.1 time: 0.158941 Aug 05 20:00:19.137218 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 537/1089] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:18 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:20.158434 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:20.159085 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:20.165461 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:20.165951 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:20.166388 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:20.167112 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:20.167573 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:20.168502 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:20.304515 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:20.313358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-970786f4-b7c9-466a-ba79-d583776df34f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1453 microversion: 2.1 time: 0.158742 Aug 05 20:00:20.313934 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 553/1090] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:20 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:20.334412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:20.335088 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:20.341540 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:20.342026 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:20.342468 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:20.343247 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:20.343695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:20.344127 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:20.477138 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:20.484863 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f1082211-cca3-4564-b0a7-76df232cb003 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1453 microversion: 2.1 time: 0.154260 Aug 05 20:00:20.485438 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 538/1091] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:20 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:22.396787 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-a8c65faa-550a-4c46-a9e5-415b6ac75aa6 req-ae59afa2-d5c8-4e46-8da3-e460016d6513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d121c63f-0748-4dbc-85f0-09614af1dc82", "tag": "d57daa02-7dd2-467f-a0dc-bca9b23305d8"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:22.407384 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-a8c65faa-550a-4c46-a9e5-415b6ac75aa6 req-ae59afa2-d5c8-4e46-8da3-e460016d6513 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:22.407872 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-a8c65faa-550a-4c46-a9e5-415b6ac75aa6 req-ae59afa2-d5c8-4e46-8da3-e460016d6513 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:22.408310 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-a8c65faa-550a-4c46-a9e5-415b6ac75aa6 req-ae59afa2-d5c8-4e46-8da3-e460016d6513 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:22.419813 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-a8c65faa-550a-4c46-a9e5-415b6ac75aa6 req-ae59afa2-d5c8-4e46-8da3-e460016d6513 service nova] Creating event network-changed:d57daa02-7dd2-467f-a0dc-bca9b23305d8 for instance d121c63f-0748-4dbc-85f0-09614af1dc82 on hv-cinder-85220 Aug 05 20:00:22.425096 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-a8c65faa-550a-4c46-a9e5-415b6ac75aa6 req-ae59afa2-d5c8-4e46-8da3-e460016d6513 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092816 Aug 05 20:00:22.425833 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 554/1092] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:23.573517 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:23.574184 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:23.581162 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:23.581646 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:23.582077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:23.582795 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:23.583248 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:23.583671 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:23.607477 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.objects.instance [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lazy-loading 'flavor' on Instance uuid 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 {{(pid=124552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:00:23.679622 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-34731af7-fbeb-4a97-b813-ada22a0182d5 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "POST /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57/action" status: 202 len: 0 microversion: 2.1 time: 0.109767 Aug 05 20:00:23.680191 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 539/1093] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 20:00:23 2022] POST /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:00:23.689380 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:23.690091 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:23.696926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:23.697394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:23.697859 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:23.698562 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:23.699042 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:23.700574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:23.836555 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:23.846106 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d0bab95c-4f50-4c6c-b1a0-b382383d83fd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.161116 Aug 05 20:00:23.846784 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 555/1094] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:23 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:24.869831 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:24.870765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:24.877402 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:24.877888 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:24.878330 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:24.879055 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:24.879512 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:24.879941 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:25.011387 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:25.020110 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-68fa1ed2-841e-488a-8f03-6c0c72d2fba0 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.155167 Aug 05 20:00:25.020688 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 540/1095] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:24 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:26.042061 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:26.042697 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:26.050438 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:26.050926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:26.051424 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:26.052335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:26.053342 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:26.053776 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:26.186247 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:26.193738 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-63bf6b16-65e1-47ce-9943-76ff390a9cd1 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.156419 Aug 05 20:00:26.194303 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 556/1096] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:26 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:27.215850 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:27.216755 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:27.223367 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:27.224064 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:27.224531 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:27.225228 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:27.225681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:27.226127 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:27.249300 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:27.382168 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:27.391124 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-afbd5124-eb3c-480e-a4aa-f4a239af7177 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.179847 Aug 05 20:00:27.391759 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 541/1097] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:27 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:28.412845 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:28.413498 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:28.420948 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:28.421437 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:28.421879 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:28.422583 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:28.423277 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:28.423875 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:28.568574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:28.576260 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-cb42090c-b75c-471a-9c31-d0f5b0f96fdd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.167470 Aug 05 20:00:28.576822 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 557/1098] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:28 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:29.597263 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:29.597879 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:29.604280 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:29.604764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:29.605214 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:29.606420 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:29.607118 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:29.607530 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:29.745256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:29.753794 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-adb555ab-dd25-4426-9def-91628ea54785 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.160425 Aug 05 20:00:29.754366 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 542/1099] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:29 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:30.774673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:30.775335 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:30.778488 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=33 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:30.783914 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:30.784411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:30.784855 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:30.785572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:30.786032 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:30.786465 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:30.789367 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=77 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:30.919641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:30.927087 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-42c27012-26fe-4728-b643-dd925650a452 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.156327 Aug 05 20:00:30.927656 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 558/1100] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:30 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:31.948597 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:31.949398 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:31.952202 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:31.957517 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:31.958002 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:31.958442 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:31.959159 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:31.959608 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:31.960032 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:32.097108 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:32.104599 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3d08d48b-2981-4b6c-8c60-6eebe5330c2f tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.159899 Aug 05 20:00:32.105168 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 543/1101] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:31 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:33.125820 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:33.126436 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:33.132965 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:33.133452 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:33.133891 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:33.134589 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:33.135075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:33.135506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:33.272164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:33.280199 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-3116fe4d-77bb-4a12-8c99-1a2bc87b6c81 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.159041 Aug 05 20:00:33.280761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 559/1102] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:33 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:34.300953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:34.301569 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:34.307932 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:34.308419 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:34.310268 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:34.311324 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:34.311780 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:34.312206 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:34.488685 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:34.497527 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-440c97f0-6555-4544-8dda-62dda1288a92 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.199172 Aug 05 20:00:34.497527 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 544/1103] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:34 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:35.518926 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:35.519572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:35.525896 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:35.526372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:35.526845 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:35.527533 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:35.528037 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:35.528469 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:35.658213 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:35.665714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-93d6cefc-3c12-4c4d-8b34-abce2893f653 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.151298 Aug 05 20:00:35.666280 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 560/1104] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:35 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:36.688526 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:36.689117 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:36.695557 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:36.696036 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:36.696478 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:36.697167 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:36.697619 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:36.698045 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:36.830576 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:36.838275 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0256f178-a4f1-4b4d-99fc-532f9856a541 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1569 microversion: 2.1 time: 0.154379 Aug 05 20:00:36.839199 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 545/1105] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:36 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:36.860382 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:36.861029 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:36.867508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:36.867986 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:36.868419 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:36.869108 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:36.869561 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:36.870046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:36.961449 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124553) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:00:37.033704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-92202eef-25bd-4d20-94fe-f3595da6655b tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "POST /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57/action" status: 202 len: 0 microversion: 2.1 time: 0.178205 Aug 05 20:00:37.034317 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 561/1106] 10.222.0.86 () {60 vars in 1278 bytes} [Fri Aug 5 20:00:36 2022] POST /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:00:37.043528 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:37.044192 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:37.051121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:37.051847 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:37.052298 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:37.053016 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:37.053482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:37.054098 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:37.195375 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:37.202933 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c35a463c-fe92-41cd-a8b7-5b08d9f1f567 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1517 microversion: 2.1 time: 0.163457 Aug 05 20:00:37.203505 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 546/1107] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:37 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:38.225347 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:38.226194 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:38.234161 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:38.234685 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:38.235138 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:38.235878 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:38.236334 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:38.236761 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:38.387381 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:38.396327 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f0b346ef-f251-4931-8c76-02cfc7225ce2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1519 microversion: 2.1 time: 0.176264 Aug 05 20:00:38.396913 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 562/1108] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:38 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:39.419338 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:39.419997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:39.426697 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:39.427168 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:39.427595 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:39.428307 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:39.428765 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:39.429197 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:39.436450 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-668c36e0-3a00-462f-b07f-1a3c865736b5 req-c0ed87e0-8d87-4c26-ab33-f714f6b5c89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57", "name": "network-vif-unplugged", "status": "completed", "tag": "7a16a252-25ee-4fe7-a37e-0af634888aa4"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:39.447077 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-668c36e0-3a00-462f-b07f-1a3c865736b5 req-c0ed87e0-8d87-4c26-ab33-f714f6b5c89c service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:39.447577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-668c36e0-3a00-462f-b07f-1a3c865736b5 req-c0ed87e0-8d87-4c26-ab33-f714f6b5c89c service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:39.447972 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-668c36e0-3a00-462f-b07f-1a3c865736b5 req-c0ed87e0-8d87-4c26-ab33-f714f6b5c89c service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:39.460329 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-668c36e0-3a00-462f-b07f-1a3c865736b5 req-c0ed87e0-8d87-4c26-ab33-f714f6b5c89c service nova] Creating event network-vif-unplugged:7a16a252-25ee-4fe7-a37e-0af634888aa4 for instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 on hv-cinder-85220 Aug 05 20:00:39.466190 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-668c36e0-3a00-462f-b07f-1a3c865736b5 req-c0ed87e0-8d87-4c26-ab33-f714f6b5c89c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034003 Aug 05 20:00:39.467015 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 563/1109] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:00:39.568730 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:39.576994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-c985a405-5b7c-4103-b761-118c3872782d tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1575 microversion: 2.1 time: 0.162508 Aug 05 20:00:39.577560 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 547/1110] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:39 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:40.599011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:40.599707 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:40.606963 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:40.607440 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:40.607870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:40.608555 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:40.609007 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:40.609424 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:40.741748 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:40.750095 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1486acab-eb0a-466b-ba4d-536ca192fb59 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1575 microversion: 2.1 time: 0.155332 Aug 05 20:00:40.750676 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 564/1111] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:40 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:41.770808 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:41.771427 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:41.778341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:41.778861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:41.779298 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:41.779999 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:41.780453 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:41.780880 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:41.915183 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:41.923377 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-fb1ad0e3-1be3-4aa2-b63e-c7685dcd7f78 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1575 microversion: 2.1 time: 0.156518 Aug 05 20:00:41.923947 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 548/1112] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:41 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:42.945750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:42.946390 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:42.953985 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:42.954478 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:42.954941 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:42.955639 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:42.956101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:42.956536 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:43.096901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:43.104506 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-31c2269d-21cc-49a1-b044-9563e8107aba tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1575 microversion: 2.1 time: 0.162704 Aug 05 20:00:43.105070 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 565/1113] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:42 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:44.128583 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:44.129168 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:44.135554 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:44.136044 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:44.136485 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:44.137318 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:44.137774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:44.138204 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:44.269710 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:44.277853 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f452a393-179f-4fb4-abd5-1ed0807c5bb2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1575 microversion: 2.1 time: 0.152727 Aug 05 20:00:44.278648 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 549/1114] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:44 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:45.300301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:45.301046 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:45.307842 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:45.308411 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:45.309075 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:45.309779 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:45.310245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:45.310701 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:45.452508 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:45.460052 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-de59f195-bd2b-4f76-a4e3-283a9323f5cd tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1575 microversion: 2.1 time: 0.164655 Aug 05 20:00:45.460626 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 566/1115] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:45 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:00:46.482650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:46.483356 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:46.489855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:46.490461 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:46.490935 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:46.491637 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:46.492087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:46.492514 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:46.629684 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:46.638122 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-bc8a66b7-41bc-49e4-8d65-4f027ba042dc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1575 microversion: 2.1 time: 0.159936 Aug 05 20:00:46.638719 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 550/1116] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:46 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:47.658282 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:47.658924 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:00:47.665365 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:47.665851 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:47.666294 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:47.667019 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:47.667476 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:47.668399 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:47.804588 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:00:47.813054 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-b144e320-200a-418e-909d-b2dd44d539a7 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1562 microversion: 2.1 time: 0.158661 Aug 05 20:00:47.813791 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 567/1117] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:00:47 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:00:49.570231 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-faeda806-35df-4c6a-b1f3-0694d030bbc2 req-b74351a7-163e-47a7-9e68-c13501ab3851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57", "name": "network-vif-plugged", "status": "completed", "tag": "7a16a252-25ee-4fe7-a37e-0af634888aa4"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:00:49.581593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-faeda806-35df-4c6a-b1f3-0694d030bbc2 req-b74351a7-163e-47a7-9e68-c13501ab3851 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:49.582087 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-faeda806-35df-4c6a-b1f3-0694d030bbc2 req-b74351a7-163e-47a7-9e68-c13501ab3851 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:49.582525 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-faeda806-35df-4c6a-b1f3-0694d030bbc2 req-b74351a7-163e-47a7-9e68-c13501ab3851 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:49.594125 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-faeda806-35df-4c6a-b1f3-0694d030bbc2 req-b74351a7-163e-47a7-9e68-c13501ab3851 service nova] Creating event network-vif-plugged:7a16a252-25ee-4fe7-a37e-0af634888aa4 for instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 on hv-cinder-85220 Aug 05 20:00:49.599270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-faeda806-35df-4c6a-b1f3-0694d030bbc2 req-b74351a7-163e-47a7-9e68-c13501ab3851 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032868 Aug 05 20:00:49.599934 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 551/1118] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:54.513953 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:00:54.514600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Fri Aug 5 20:00:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:02:04.397166 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:04.398221 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:04.401814 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=17 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:04.402281 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:04.402794 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:04.403097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=58 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:04.411782 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:04.412394 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:04.412696 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:04.413407 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:04.414059 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:04.414477 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:04.443829 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Going to try to terminate instance {{(pid=124553) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:02:04.476295 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-9274aaf3-f36f-4d6f-9403-1d4fcffa83cc req-5a844e04-135f-4b94-830b-efccd29617b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57", "tag": "7a16a252-25ee-4fe7-a37e-0af634888aa4"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:04.488066 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9274aaf3-f36f-4d6f-9403-1d4fcffa83cc req-5a844e04-135f-4b94-830b-efccd29617b8 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:04.488590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9274aaf3-f36f-4d6f-9403-1d4fcffa83cc req-5a844e04-135f-4b94-830b-efccd29617b8 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:04.489086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9274aaf3-f36f-4d6f-9403-1d4fcffa83cc req-5a844e04-135f-4b94-830b-efccd29617b8 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:04.500106 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-9274aaf3-f36f-4d6f-9403-1d4fcffa83cc req-5a844e04-135f-4b94-830b-efccd29617b8 service nova] Creating event network-changed:7a16a252-25ee-4fe7-a37e-0af634888aa4 for instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 on hv-cinder-85220 Aug 05 20:02:04.507221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-9274aaf3-f36f-4d6f-9403-1d4fcffa83cc req-5a844e04-135f-4b94-830b-efccd29617b8 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107213 Aug 05 20:02:04.510844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 552/1119] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:04.543851 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1a9a121d-c139-497c-bba0-0731a25dc27a tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 204 len: 0 microversion: 2.1 time: 0.148258 Aug 05 20:02:04.548695 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 568/1120] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 20:02:04 2022] DELETE /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:02:04.555097 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:04.555817 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:04.567072 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:04.567591 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:04.568393 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:04.569133 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:04.569596 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:04.570152 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:04.712558 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:04.722069 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3aef613f-fbec-4de9-9a01-49b6a8265768 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.172113 Aug 05 20:02:04.722719 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 553/1121] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:04 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:05.745374 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:05.746200 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:05.753842 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:05.754343 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:05.754815 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:05.755525 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:05.755985 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:05.756413 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:05.902884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:05.911572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-0db46118-6e01-4efd-b363-dccf25015b40 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1568 microversion: 2.1 time: 0.170550 Aug 05 20:02:05.912139 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 569/1122] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:05 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:06.897110 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-9ab86d4c-751f-4d4e-a626-b6f73801280d req-bb2d2712-57c4-4415-8a88-f3c06b8c5a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57", "name": "network-vif-deleted", "tag": "7a16a252-25ee-4fe7-a37e-0af634888aa4"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:06.907928 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9ab86d4c-751f-4d4e-a626-b6f73801280d req-bb2d2712-57c4-4415-8a88-f3c06b8c5a95 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:06.908409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9ab86d4c-751f-4d4e-a626-b6f73801280d req-bb2d2712-57c4-4415-8a88-f3c06b8c5a95 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:06.908837 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-9ab86d4c-751f-4d4e-a626-b6f73801280d req-bb2d2712-57c4-4415-8a88-f3c06b8c5a95 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:06.920341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-9ab86d4c-751f-4d4e-a626-b6f73801280d req-bb2d2712-57c4-4415-8a88-f3c06b8c5a95 service nova] Creating event network-vif-deleted:7a16a252-25ee-4fe7-a37e-0af634888aa4 for instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 on hv-cinder-85220 Aug 05 20:02:06.925700 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-9ab86d4c-751f-4d4e-a626-b6f73801280d req-bb2d2712-57c4-4415-8a88-f3c06b8c5a95 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032289 Aug 05 20:02:06.926299 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 554/1123] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:06.933576 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:06.934193 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:06.942066 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:06.942563 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:06.943060 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:06.943902 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:06.944368 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:06.944796 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:07.010558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:07.018735 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-774388bf-f704-400f-ac54-a0cd0471cbf2 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1220 microversion: 2.1 time: 0.089173 Aug 05 20:02:07.019305 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 570/1124] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:06 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:08.040931 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:08.041642 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:08.048888 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:08.049321 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:08.049774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:08.050475 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:08.050972 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:08.051406 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:08.117817 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:08.125343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a45869e7-b932-41fa-a680-f016e1b351fc tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1220 microversion: 2.1 time: 0.089189 Aug 05 20:02:08.127520 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 555/1125] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:08 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:09.148360 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:09.149111 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:09.155729 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:09.156207 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:09.156641 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:09.157523 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:09.157980 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:09.158403 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:09.191491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:09.191818 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:09.192359 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:09.192847 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lazy-loading 'fault' on Instance uuid 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:02:09.239018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '802ed5c51d184f6c925f31ab6020ac93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ea1b6ed7d647b8987e6c128248cab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:09.248716 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-8fc72e0a-f352-4310-9110-07f12635a6da tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 200 len: 1225 microversion: 2.1 time: 0.104391 Aug 05 20:02:09.249558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 571/1126] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:09 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:09.382205 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1495150651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1274635914", "security_groups": [{"name": "tempest-secgroup-smoke-493261908"}], "block_device_mapping_v2": [{"uuid": "87ce3393-b878-4f91-8c0d-5ebb7d1bc4ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "502545db-6859-4120-9256-0caba07649d2"}]}} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:09.495453 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.network.neutron [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] validate_networks() for [('502545db-6859-4120-9256-0caba07649d2', None, None, None, None, None)] {{(pid=124552) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:02:10.177969 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Flavor limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:02:10.178397 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Image limits 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:02:10.178921 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Flavor pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:02:10.179385 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Image pref 0:0:0 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:02:10.179888 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.virt.hardware [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:02:10.188667 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:10.189409 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:10.189864 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:10.190709 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:10.191174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:10.191610 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:10.208877 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Getting quotas for project 7372aebdf6554202a45b0bbd7bad0700. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:02:10.212862 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.quota [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Getting quotas for user 19c2f15eb1644278b911cc50370da9b7 and project 7372aebdf6554202a45b0bbd7bad0700. Resources: {'cores', 'instances', 'ram'} {{(pid=124552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:02:10.270643 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:10.271302 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] [instance: 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:10.271852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Going to run 1 instances... {{(pid=124552) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:02:10.274166 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87ce3393-b878-4f91-8c0d-5ebb7d1bc4ed',volume_size=None,volume_type=None)] {{(pid=124552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:02:10.278442 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:10.279033 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:10.279572 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:10.280300 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:10.280911 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:10.281245 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:10.295984 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] HTTP exception thrown: Instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 could not be found. Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Request method failure captured: Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 HTTP/1.1 Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XYu89k-qlIGCO-o4VPKW8cedPTqXBl9PCHCbYlyRySCXVx1J2kAqz_tV5TLUdL8sL6q_rX45Yf8aVmO9MoXavVBT3kEKc_jz6dDTdwpzh5if8jY4aKMWZ7qAZPJvaiVGLa1dVuhDQrjxn3O2oMtzO9bLfHFiJ5pnsrbX7gbKSTF5zY Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 47ea1b6ed7d647b8987e6c128248cab6 Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-TestShelveInstance-2121837672 Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 20:02:10.298201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/47ea1b6ed7d647b8987e6c128248cab6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/47ea1b6ed7d647b8987e6c128248cab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_47ea1b6ed7d647b8987e6c128248cab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/47ea1b6ed7d647b8987e6c128248cab6"}]}] Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-TestShelveInstance-2121837672 Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 47ea1b6ed7d647b8987e6c128248cab6 Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-TestShelveInstance-2121837672 Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-TestShelveInstance-2121837672-project Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 802ed5c51d184f6c925f31ab6020ac93 Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-TestShelveInstance-2121837672-project Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 could not be found. Aug 05 20:02:10.299868 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57'} Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 could not be found. Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:02:10.300714 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 could not be found. Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 could not be found. Aug 05 20:02:10.302181 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:02:10.303429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Returning 404 to user: Instance 2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:02:10.303429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a4676594-758d-4940-9fd8-fb12a8bafa12 tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57" status: 404 len: 111 microversion: 2.1 time: 0.033013 Aug 05 20:02:10.303429 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 572/1127] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:10 2022] GET /compute/v2.1/servers/2bf9d7f2-d6a2-48c2-88cd-c0dd074f5e57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:02:10.416079 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2982f111-0b35-4fe2-8ef9-138afa23b714 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.037766 Aug 05 20:02:10.422333 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 556/1128] 10.222.0.86 () {60 vars in 1147 bytes} [Fri Aug 5 20:02:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:02:10.428837 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-4b8424de-4599-4876-b795-199eb61ebce7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:10.429372 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-4b8424de-4599-4876-b795-199eb61ebce7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:10.482040 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-b13acd50-116e-4ef5-a579-d9848c7d66ea tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] Calling method '.version_select at 0x7f18c81399d0>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:10.508704 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-4b8424de-4599-4876-b795-199eb61ebce7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:10.508927 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-b13acd50-116e-4ef5-a579-d9848c7d66ea tempest-TestShelveInstance-2121837672 tempest-TestShelveInstance-2121837672-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1975071092" status: 202 len: 0 microversion: 2.1 time: 0.031406 Aug 05 20:02:10.509711 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 557/1129] 10.222.0.86 () {58 vars in 1254 bytes} [Fri Aug 5 20:02:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1975071092 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:02:10.528976 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-4b8424de-4599-4876-b795-199eb61ebce7 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1095 microversion: 2.1 time: 0.104734 Aug 05 20:02:10.529655 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 573/1130] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:10 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:02:11.552151 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:11.553383 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:11.561922 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:11.562454 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:11.562916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:11.565482 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:11.566126 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:11.566774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:11.653223 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:11.661081 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-abe02ee8-bc6a-4838-b106-b0ca9037c879 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1211 microversion: 2.1 time: 0.114314 Aug 05 20:02:11.661899 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 558/1131] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:11 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1211 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:12.684358 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:12.686876 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:12.703417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:12.704284 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:12.705490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:12.706666 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:12.707331 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:12.707930 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:12.972120 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:12.980593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-f7a28c56-4bb1-435a-a820-f9161ef2bd53 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.301116 Aug 05 20:02:12.983088 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 574/1132] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:12 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:13.384345 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-c06e4d57-1181-4cd3-9662-516005cc40ea req-e7cf01d8-6cb9-4fde-b621-f8570a9a1718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "176f1c4e-4f58-4d9a-a226-3a908c8e495d", "tag": "35c6b128-68eb-4dbc-a466-808cfd0ac91c"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:13.396455 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c06e4d57-1181-4cd3-9662-516005cc40ea req-e7cf01d8-6cb9-4fde-b621-f8570a9a1718 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:13.397275 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c06e4d57-1181-4cd3-9662-516005cc40ea req-e7cf01d8-6cb9-4fde-b621-f8570a9a1718 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:13.398094 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-c06e4d57-1181-4cd3-9662-516005cc40ea req-e7cf01d8-6cb9-4fde-b621-f8570a9a1718 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:13.412289 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-c06e4d57-1181-4cd3-9662-516005cc40ea req-e7cf01d8-6cb9-4fde-b621-f8570a9a1718 service nova] Creating event network-changed:35c6b128-68eb-4dbc-a466-808cfd0ac91c for instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d on hv-cinder-85220 Aug 05 20:02:13.419916 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-c06e4d57-1181-4cd3-9662-516005cc40ea req-e7cf01d8-6cb9-4fde-b621-f8570a9a1718 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049841 Aug 05 20:02:13.425101 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 559/1133] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:14.002417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:14.003895 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:14.010542 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:14.011071 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:14.011511 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:14.012212 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:14.012664 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:14.013409 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:14.268818 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:14.276664 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-37283b84-3480-44ca-aece-7e934942139e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.278078 Aug 05 20:02:14.291332 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 575/1134] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:13 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:15.299422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:15.300239 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:15.306670 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:15.307463 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:15.307997 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:15.308784 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:15.309330 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:15.309822 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:15.534601 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:15.542749 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-a6d93ddd-f2ea-4a7a-ab96-660c45c6e051 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.248585 Aug 05 20:02:15.543623 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 560/1135] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:15 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:02:16.566790 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:16.567492 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:16.574278 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:16.574819 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:16.575246 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:16.576165 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:16.576785 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:16.577412 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:16.820206 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:16.828465 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-d8ef6ad9-176d-45af-8456-735cab650d76 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.266708 Aug 05 20:02:16.829870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 576/1136] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:16 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:02:17.851632 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:17.852276 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:17.858478 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:17.859005 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:17.859453 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:17.860775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:17.860775 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:17.861093 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:18.019353 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:18.031470 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-1a6596a8-f003-412f-8964-95f595c67f7e tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.183309 Aug 05 20:02:18.031590 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 561/1137] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:17 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:19.053385 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:19.054021 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:19.060916 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:19.061396 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:19.061826 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:19.062526 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:19.063000 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:19.064519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:19.221988 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:19.229519 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-fbcc398f-208f-4417-81ba-089caf7e5847 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.180110 Aug 05 20:02:19.230089 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 577/1138] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:19 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:02:20.252602 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=2 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:20.253356 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell0:SELECT=6 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:20.477230 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:20.477861 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:20.484121 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:20.484610 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:20.485809 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:20.486741 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:20.487189 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:20.487625 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:20.623987 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:20.631770 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-0ae9cbf7-27df-4a7f-9d34-005138d6cf02 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.385071 Aug 05 20:02:20.632337 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 562/1139] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:20 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:21.653361 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:21.653979 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:21.656413 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell0:SELECT=2 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:21.661814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:21.662301 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:21.662770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:21.663470 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:21.663930 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:21.664362 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:21.794172 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:21.802684 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-c5b1944b-1544-4dce-9580-9a451f711e4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.153179 Aug 05 20:02:21.803243 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 578/1140] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:21 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:22.823901 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:22.824476 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:22.831844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:22.832326 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:22.832760 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:22.833442 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:22.833895 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:22.834317 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:22.966549 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:22.974777 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5aba1900-6a12-4022-bf4d-6ea7daa2ce26 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.154841 Aug 05 20:02:22.975343 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 563/1141] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:22 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:23.995512 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:23.996121 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:24.004093 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:24.004582 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:24.005013 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:24.005715 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:24.006164 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:24.006586 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:24.128581 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-7a52a7c0-bda1-4265-af1f-aefbc6161205 req-5bf49522-bbee-44d4-a7d1-4e28baefc78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176f1c4e-4f58-4d9a-a226-3a908c8e495d", "name": "network-vif-plugged", "status": "completed", "tag": "35c6b128-68eb-4dbc-a466-808cfd0ac91c"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:24.139587 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-7a52a7c0-bda1-4265-af1f-aefbc6161205 req-5bf49522-bbee-44d4-a7d1-4e28baefc78e service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:24.140072 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-7a52a7c0-bda1-4265-af1f-aefbc6161205 req-5bf49522-bbee-44d4-a7d1-4e28baefc78e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:24.140723 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-7a52a7c0-bda1-4265-af1f-aefbc6161205 req-5bf49522-bbee-44d4-a7d1-4e28baefc78e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:24.151814 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:24.153296 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-7a52a7c0-bda1-4265-af1f-aefbc6161205 req-5bf49522-bbee-44d4-a7d1-4e28baefc78e service nova] Creating event network-vif-plugged:35c6b128-68eb-4dbc-a466-808cfd0ac91c for instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d on hv-cinder-85220 Aug 05 20:02:24.159430 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-7a52a7c0-bda1-4265-af1f-aefbc6161205 req-5bf49522-bbee-44d4-a7d1-4e28baefc78e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100391 Aug 05 20:02:24.160042 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 564/1142] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:24.160444 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-62c1b0f3-43cf-4c60-9c22-0004ae3e6693 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.168604 Aug 05 20:02:24.161173 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 579/1143] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:23 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:25.182396 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:25.183211 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:25.189645 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:25.190132 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:25.190575 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:25.191298 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:25.191764 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:25.192198 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:25.328570 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:25.336855 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-2124a221-8a8a-40e6-a31f-96f50b612926 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1266 microversion: 2.1 time: 0.159204 Aug 05 20:02:25.337412 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 565/1144] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:25 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:26.357403 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:26.358018 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:26.365560 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:26.366047 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:26.366494 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:26.367218 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:26.367673 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:26.368103 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:26.502296 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:26.509972 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-06ec240e-9da4-45eb-975b-25d111ca8d4f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1453 microversion: 2.1 time: 0.156545 Aug 05 20:02:26.510539 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 580/1145] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:26 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:26.529695 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:26.530308 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:26.537277 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:26.537698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:26.538132 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:26.538929 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:26.539389 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:26.539818 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:26.672269 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:26.680165 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f8175120-b998-4093-a244-bf2455d8c53a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1453 microversion: 2.1 time: 0.154296 Aug 05 20:02:26.680727 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 566/1146] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:26 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:28.294126 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-1e62cb94-adc2-4b45-9fe7-23729f936291 req-1fe8bb5d-ce30-49ea-a660-1910db5df764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "176f1c4e-4f58-4d9a-a226-3a908c8e495d", "tag": "35c6b128-68eb-4dbc-a466-808cfd0ac91c"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:28.304397 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-1e62cb94-adc2-4b45-9fe7-23729f936291 req-1fe8bb5d-ce30-49ea-a660-1910db5df764 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:28.304881 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-1e62cb94-adc2-4b45-9fe7-23729f936291 req-1fe8bb5d-ce30-49ea-a660-1910db5df764 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:28.305346 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-1e62cb94-adc2-4b45-9fe7-23729f936291 req-1fe8bb5d-ce30-49ea-a660-1910db5df764 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:28.316900 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-1e62cb94-adc2-4b45-9fe7-23729f936291 req-1fe8bb5d-ce30-49ea-a660-1910db5df764 service nova] Creating event network-changed:35c6b128-68eb-4dbc-a466-808cfd0ac91c for instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d on hv-cinder-85220 Aug 05 20:02:28.321899 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-1e62cb94-adc2-4b45-9fe7-23729f936291 req-1fe8bb5d-ce30-49ea-a660-1910db5df764 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033573 Aug 05 20:02:28.322736 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 581/1147] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:03:14.727271 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:03:14.727960 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Fri Aug 5 20:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:03:26.146863 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:03:26.147528 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Fri Aug 5 20:03:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:03:56.504680 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:56.505466 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG dbcounter [-] [124553] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:56.506380 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:56.506994 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:56.509436 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:56.510144 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG dbcounter [-] [124552] Writing DB stats nova_cell1:SELECT=64 {{(pid=124552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:56.517606 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [req-d5c2e6d3-2621-437d-9bec-183d3b69486c req-15828bb8-52af-4e33-a6ce-cf4f99f8572e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "176f1c4e-4f58-4d9a-a226-3a908c8e495d", "tag": "35c6b128-68eb-4dbc-a466-808cfd0ac91c"}]} {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:56.526736 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.527492 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.528170 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.529130 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.529491 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-d5c2e6d3-2621-437d-9bec-183d3b69486c req-15828bb8-52af-4e33-a6ce-cf4f99f8572e service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.529635 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.529959 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-d5c2e6d3-2621-437d-9bec-183d3b69486c req-15828bb8-52af-4e33-a6ce-cf4f99f8572e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.530135 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.530375 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [req-d5c2e6d3-2621-437d-9bec-183d3b69486c req-15828bb8-52af-4e33-a6ce-cf4f99f8572e service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.546381 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.compute.server_external_events [req-d5c2e6d3-2621-437d-9bec-183d3b69486c req-15828bb8-52af-4e33-a6ce-cf4f99f8572e service nova] Creating event network-changed:35c6b128-68eb-4dbc-a466-808cfd0ac91c for instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d on hv-cinder-85220 Aug 05 20:03:56.553143 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [req-d5c2e6d3-2621-437d-9bec-183d3b69486c req-15828bb8-52af-4e33-a6ce-cf4f99f8572e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051554 Aug 05 20:03:56.554218 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 582/1148] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:56.562138 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Going to try to terminate instance {{(pid=124552) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:03:56.647938 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-7e3afa11-3800-4041-ab40-c5b3eb4c378d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "DELETE /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 204 len: 0 microversion: 2.1 time: 0.152301 Aug 05 20:03:56.648897 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 567/1149] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 20:03:56 2022] DELETE /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:03:56.657906 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:56.658610 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:56.667361 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.667857 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.668299 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.669007 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.669473 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.669893 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.810274 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:56.819002 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-906d482d-78ec-4b78-9f50-158cc27f5ad8 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1578 microversion: 2.1 time: 0.165416 Aug 05 20:03:56.819577 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 583/1150] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:56 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:57.840877 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:57.841586 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:57.848577 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:57.849063 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:57.849503 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:57.850196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:57.850681 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:57.851114 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:58.019259 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:58.027418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-5634950c-8735-4ecb-ab3f-04e0ebb1059c tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1578 microversion: 2.1 time: 0.190125 Aug 05 20:03:58.027418 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 568/1151] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:57 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:59.047981 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:59.048602 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:59.055459 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:59.055944 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:59.056379 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:59.057079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:59.057532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:59.057962 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:59.200273 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:59.208992 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-a3903a15-15b9-49b2-80f5-a9c223b330ac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1578 microversion: 2.1 time: 0.164814 Aug 05 20:03:59.209586 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 584/1152] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:59 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:59.788672 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-ee6feb9b-5d89-4004-a805-4dd88c562a00 req-f8fdbc91-23e4-413b-8a4b-45e93ca99b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176f1c4e-4f58-4d9a-a226-3a908c8e495d", "name": "network-vif-deleted", "tag": "35c6b128-68eb-4dbc-a466-808cfd0ac91c"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:59.801078 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-ee6feb9b-5d89-4004-a805-4dd88c562a00 req-f8fdbc91-23e4-413b-8a4b-45e93ca99b0a service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:59.801747 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-ee6feb9b-5d89-4004-a805-4dd88c562a00 req-f8fdbc91-23e4-413b-8a4b-45e93ca99b0a service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:59.802199 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-ee6feb9b-5d89-4004-a805-4dd88c562a00 req-f8fdbc91-23e4-413b-8a4b-45e93ca99b0a service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:59.813774 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-ee6feb9b-5d89-4004-a805-4dd88c562a00 req-f8fdbc91-23e4-413b-8a4b-45e93ca99b0a service nova] Creating event network-vif-deleted:35c6b128-68eb-4dbc-a466-808cfd0ac91c for instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d on hv-cinder-85220 Aug 05 20:03:59.821452 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-ee6feb9b-5d89-4004-a805-4dd88c562a00 req-f8fdbc91-23e4-413b-8a4b-45e93ca99b0a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036597 Aug 05 20:03:59.822052 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 569/1153] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:00.230558 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:00.231360 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:00.238425 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:00.238949 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:00.239388 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:00.240079 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:00.240532 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:00.240955 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:00.271609 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:00.272095 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:00.272512 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:00.272957 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.objects.instance [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lazy-loading 'fault' on Instance uuid 176f1c4e-4f58-4d9a-a226-3a908c8e495d {{(pid=124553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:04:00.314431 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:00.322490 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-1fa0a289-5fda-4e25-b043-3170ea1499c4 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 200 len: 1231 microversion: 2.1 time: 0.095788 Aug 05 20:04:00.323085 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 585/1154] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:00 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:01.344852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:01.345566 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 176f1c4e-4f58-4d9a-a226-3a908c8e495d] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:01.353048 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:01.353540 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:01.353986 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:01.354716 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:01.355180 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:01.355612 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:01.368706 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] HTTP exception thrown: Instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d could not be found. Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Request method failure captured: Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d HTTP/1.1 Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XYaaad4PEScnBhMnpRdD1sb2uzjE8Gfvir0PQew2beWkonFs_mP-Ol0aMDuLgI2CKLunQlDbNPAFO7eEVFN-AkZDtaqZZDqm6dwQIKQpM4C08dEnhHmm6MXRSdDUHDdQK-ZyX-dVCbsilh2Clr98e0Zfdg-edaozqFChou-d_ue8tk Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 20:04:01.370341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}] Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 19c2f15eb1644278b911cc50370da9b7 Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d could not be found. Aug 05 20:04:01.372270 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '176f1c4e-4f58-4d9a-a226-3a908c8e495d'} Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d could not be found. Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:01.373265 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d could not be found. Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d could not be found. Aug 05 20:04:01.375030 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:01.376648 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Returning 404 to user: Instance 176f1c4e-4f58-4d9a-a226-3a908c8e495d could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:01.376648 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-616aa8da-61a1-4071-88d5-33a3b0e3955d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d" status: 404 len: 111 microversion: 2.1 time: 0.031170 Aug 05 20:04:01.376648 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 570/1155] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:01 2022] GET /compute/v2.1/servers/176f1c4e-4f58-4d9a-a226-3a908c8e495d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:04.444780 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:04.445441 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:04.447322 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-df78110d-fff0-473a-821e-660e24515bd6 req-3cc53a0d-28b5-4fa6-a836-0685b53de796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d121c63f-0748-4dbc-85f0-09614af1dc82", "tag": "d57daa02-7dd2-467f-a0dc-bca9b23305d8"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:04.452758 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.453653 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.454231 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.454966 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.455417 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.455838 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.459513 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-df78110d-fff0-473a-821e-660e24515bd6 req-3cc53a0d-28b5-4fa6-a836-0685b53de796 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.460181 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-df78110d-fff0-473a-821e-660e24515bd6 req-3cc53a0d-28b5-4fa6-a836-0685b53de796 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.460628 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-df78110d-fff0-473a-821e-660e24515bd6 req-3cc53a0d-28b5-4fa6-a836-0685b53de796 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.473787 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-df78110d-fff0-473a-821e-660e24515bd6 req-3cc53a0d-28b5-4fa6-a836-0685b53de796 service nova] Creating event network-changed:d57daa02-7dd2-467f-a0dc-bca9b23305d8 for instance d121c63f-0748-4dbc-85f0-09614af1dc82 on hv-cinder-85220 Aug 05 20:04:04.478910 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-df78110d-fff0-473a-821e-660e24515bd6 req-3cc53a0d-28b5-4fa6-a836-0685b53de796 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035381 Aug 05 20:04:04.479511 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 571/1156] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:04.488574 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Going to try to terminate instance {{(pid=124553) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:04:04.583884 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-731c3521-484d-41c7-bfc0-27d2e4a6e433 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 204 len: 0 microversion: 2.1 time: 0.143860 Aug 05 20:04:04.588088 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 586/1157] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 20:04:04 2022] DELETE /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:04:04.594429 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:04.595351 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:04.602813 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.603376 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.603824 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.604580 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.605039 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.605478 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.775213 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.policy [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124552) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:04.784600 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-3f49d1fd-a269-4afa-9a66-adba31ced66d tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1578 microversion: 2.1 time: 0.194840 Aug 05 20:04:04.785174 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 572/1158] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:04 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1578 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:05.806197 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:05.806918 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:05.813443 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:05.813921 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:05.814360 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:05.815076 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:05.815932 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:05.816497 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:05.953996 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:05.963012 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-74aa0beb-842f-4142-b7e1-982b75a84bac tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1578 microversion: 2.1 time: 0.160974 Aug 05 20:04:05.963593 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 587/1159] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:05 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:06.838722 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [req-b9a6572d-ccfb-470c-98ab-2f2b61c3bd62 req-75025b94-1416-4fcf-a6c5-42ada7ce6924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d121c63f-0748-4dbc-85f0-09614af1dc82", "name": "network-vif-deleted", "tag": "d57daa02-7dd2-467f-a0dc-bca9b23305d8"}]} {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:06.849722 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b9a6572d-ccfb-470c-98ab-2f2b61c3bd62 req-75025b94-1416-4fcf-a6c5-42ada7ce6924 service nova] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:06.850196 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b9a6572d-ccfb-470c-98ab-2f2b61c3bd62 req-75025b94-1416-4fcf-a6c5-42ada7ce6924 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:06.850650 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [req-b9a6572d-ccfb-470c-98ab-2f2b61c3bd62 req-75025b94-1416-4fcf-a6c5-42ada7ce6924 service nova] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:06.863573 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.compute.server_external_events [req-b9a6572d-ccfb-470c-98ab-2f2b61c3bd62 req-75025b94-1416-4fcf-a6c5-42ada7ce6924 service nova] Creating event network-vif-deleted:d57daa02-7dd2-467f-a0dc-bca9b23305d8 for instance d121c63f-0748-4dbc-85f0-09614af1dc82 on hv-cinder-85220 Aug 05 20:04:06.868561 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [req-b9a6572d-ccfb-470c-98ab-2f2b61c3bd62 req-75025b94-1416-4fcf-a6c5-42ada7ce6924 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033495 Aug 05 20:04:06.869197 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 573/1160] 10.222.0.86 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:06.984547 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:06.985201 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:06.992524 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:06.993011 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:06.993453 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:06.994151 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:06.994607 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:06.995061 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:07.060225 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.policy [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c2f15eb1644278b911cc50370da9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7372aebdf6554202a45b0bbd7bad0700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124553) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:07.068882 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-39b4b5cb-1139-48ae-bde3-065917eeaa5f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 200 len: 1225 microversion: 2.1 time: 0.088247 Aug 05 20:04:07.081901 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 588/1161] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:06 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:08.092029 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:08.092942 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: d121c63f-0748-4dbc-85f0-09614af1dc82] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:08.099341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.099825 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.100269 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.100962 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.101422 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.101852 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.115698 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] HTTP exception thrown: Instance d121c63f-0748-4dbc-85f0-09614af1dc82 could not be found. Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Request method failure captured: Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 HTTP/1.1 Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XYaaad4PEScnBhMnpRdD1sb2uzjE8Gfvir0PQew2beWkonFs_mP-Ol0aMDuLgI2CKLunQlDbNPAFO7eEVFN-AkZDtaqZZDqm6dwQIKQpM4C08dEnhHmm6MXRSdDUHDdQK-ZyX-dVCbsilh2Clr98e0Zfdg-edaozqFChou-d_ue8tk Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 20:04:08.117306 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}] Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 19c2f15eb1644278b911cc50370da9b7 Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance d121c63f-0748-4dbc-85f0-09614af1dc82 could not be found. Aug 05 20:04:08.119256 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': 'd121c63f-0748-4dbc-85f0-09614af1dc82'} Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d121c63f-0748-4dbc-85f0-09614af1dc82 could not be found. Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:08.120370 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d121c63f-0748-4dbc-85f0-09614af1dc82 could not be found. Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d121c63f-0748-4dbc-85f0-09614af1dc82 could not be found. Aug 05 20:04:08.122157 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.123760 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Returning 404 to user: Instance d121c63f-0748-4dbc-85f0-09614af1dc82 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:08.123760 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-974dcf38-d4ba-4a4f-9f0f-89ee35259b3a tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82" status: 404 len: 111 microversion: 2.1 time: 0.031774 Aug 05 20:04:08.123760 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 574/1162] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:08 2022] GET /compute/v2.1/servers/d121c63f-0748-4dbc-85f0-09614af1dc82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:08.822216 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:08.822770 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.compute.api [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124553) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:08.829131 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.829609 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.830044 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.830763 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.831285 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.831870 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG oslo_concurrency.lockutils [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.845023 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.wsgi [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] HTTP exception thrown: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Request method failure captured: Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: request: DELETE /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 HTTP/1.1 Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept: application/json Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Accept-Encoding: identity Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Connection: close Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Length: 0 Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Content-Type: application/json Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Host: 10.222.0.86 Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Openstack-System-Scope: None Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Auth-Token: gAAAAABi7XYaaad4PEScnBhMnpRdD1sb2uzjE8Gfvir0PQew2beWkonFs_mP-Ol0aMDuLgI2CKLunQlDbNPAFO7eEVFN-AkZDtaqZZDqm6dwQIKQpM4C08dEnhHmm6MXRSdDUHDdQK-ZyX-dVCbsilh2Clr98e0Zfdg-edaozqFChou-d_ue8tk Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Id: None Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Domain-Name: None Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Identity-Status: Confirmed Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Is-Admin-Project: True Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Id: default Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Domain-Name: Default Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Project-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Role: member,reader Aug 05 20:04:08.846933 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Roles: member,reader Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}] Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-Tenant-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Id: default Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Domain-Name: Default Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Id: 19c2f15eb1644278b911cc50370da9b7 Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: X-User-Name: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: method: > Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: exception: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.848750 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: action_args: {'id': '5eae3e8f-bb1f-4494-9e2a-059754aaee19'} Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:08.849789 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.851467 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.853101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Returning 404 to user: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. {{(pid=124553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:08.853101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-861ef681-576e-4b02-8efc-2140e4bffec9 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "DELETE /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 404 len: 111 microversion: 2.1 time: 0.030042 Aug 05 20:04:08.853101 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 589/1163] 10.222.0.86 () {58 vars in 1239 bytes} [Fri Aug 5 20:04:08 2022] DELETE /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:08.857194 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '>' {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:08.857817 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.compute.api [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] [instance: 5eae3e8f-bb1f-4494-9e2a-059754aaee19] Fetching instance by UUID {{(pid=124552) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:08.864341 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.864853 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.865320 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.866013 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Acquiring lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.866471 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.866932 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG oslo_concurrency.lockutils [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Lock "d86af12a-bae6-4132-ab5c-5ddefc8a0b0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.883221 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.wsgi [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] HTTP exception thrown: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Request method failure captured: Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: request: GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 HTTP/1.1 Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept: application/json Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Accept-Encoding: identity Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Connection: close Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Length: 0 Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Content-Type: application/json Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Host: 10.222.0.86 Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Openstack-System-Scope: None Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Auth-Token: gAAAAABi7XYaaad4PEScnBhMnpRdD1sb2uzjE8Gfvir0PQew2beWkonFs_mP-Ol0aMDuLgI2CKLunQlDbNPAFO7eEVFN-AkZDtaqZZDqm6dwQIKQpM4C08dEnhHmm6MXRSdDUHDdQK-ZyX-dVCbsilh2Clr98e0Zfdg-edaozqFChou-d_ue8tk Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Id: None Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Domain-Name: None Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Identity-Status: Confirmed Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Is-Admin-Project: True Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Id: default Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Domain-Name: Default Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Project-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Role: member,reader Aug 05 20:04:08.884746 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Roles: member,reader Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7372aebdf6554202a45b0bbd7bad0700"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7372aebdf6554202a45b0bbd7bad0700"}]}] Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Id: 7372aebdf6554202a45b0bbd7bad0700 Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-Tenant-Name: tempest-TestVolumeBootPattern-2112705652 Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Id: default Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Domain-Name: Default Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Id: 19c2f15eb1644278b911cc50370da9b7 Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: X-User-Name: tempest-TestVolumeBootPattern-2112705652-project Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: method: > Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: exception: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.886572 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: action_args: {'id': '5eae3e8f-bb1f-4494-9e2a-059754aaee19'} Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: {{(pid=124552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:08.887474 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. Aug 05 20:04:08.888834 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: ERROR nova.api.openstack.wsgi Aug 05 20:04:08.890077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: DEBUG nova.api.openstack.wsgi [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Returning 404 to user: Instance 5eae3e8f-bb1f-4494-9e2a-059754aaee19 could not be found. {{(pid=124552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:08.890077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO nova.api.openstack.requestlog [None req-f38d961e-075e-486c-97d6-77e917a9b52f tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19" status: 404 len: 111 microversion: 2.1 time: 0.033073 Aug 05 20:04:08.890077 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: [pid: 124552|app: 0|req: 575/1164] 10.222.0.86 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:08 2022] GET /compute/v2.1/servers/5eae3e8f-bb1f-4494-9e2a-059754aaee19 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:10.195675 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: DEBUG nova.api.openstack.wsgi [None req-daefbad6-3302-4e50-a95a-8f9b558cac48 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] Calling method '.version_select at 0x7f18c8159820>' {{(pid=124553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:10.219905 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO nova.api.openstack.requestlog [None req-daefbad6-3302-4e50-a95a-8f9b558cac48 tempest-TestVolumeBootPattern-2112705652 tempest-TestVolumeBootPattern-2112705652-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1274635914" status: 202 len: 0 microversion: 2.1 time: 0.028279 Aug 05 20:04:10.220957 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: [pid: 124553|app: 0|req: 590/1165] 10.222.0.86 () {58 vars in 1263 bytes} [Fri Aug 5 20:04:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1274635914 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:04:58.759844 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:04:58.760458 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Fri Aug 5 20:04:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:06:34.735812 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:06:34.736405 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Fri Aug 5 20:06:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:06:46.156281 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:06:46.157123 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Fri Aug 5 20:06:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:06:59.368344 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:06:59.369025 dv-cinder-852209-2-iscsi devstack@n-api.service[124553]: Fri Aug 5 20:06:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:07:10.272384 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:07:10.273027 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Fri Aug 5 20:07:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:07:34.527488 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:07:34.528086 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Fri Aug 5 20:07:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:08:18.767881 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:08:18.768593 dv-cinder-852209-2-iscsi devstack@n-api.service[124552]: Fri Aug 5 20:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!